Comment

Just give me the prompt and model that will generate an entire Harry Potter book so I can check it out.

Start with the first line of the book (enough that it won’t be confused with other material in the training set…) the LLM will return some of the next line. Feed it that and it will return some of what comes next, rinse, lather, repeat - researchers have gotten significant chunks of novels regurgitated this way.

source

Sort:hotnew top

FauxLiving@lemmy.world ⁨2⁩ ⁨days⁩ ago

Start with the first line of the book (enough that it won’t be confused with other material in the training set…) the LLM will return some of the next line. Feed it that and it will return some of what comes next, rinse, lather, repeat - researchers have gotten significant chunks of novels regurgitated this way.

This doesn’t seem to be working as you’re describing.

Image

Image

Image

Image

Image

source
- MangoCats@feddit.it ⁨2⁩ ⁨days⁩ ago
  That’s what I read in the article - the “researchers” may have had other interfaces they were using. Also, since that “research” came out, I suspect the models have compensated to prevent the appearance of copying…
  
  source
  - FauxLiving@lemmy.world ⁨2⁩ ⁨days⁩ ago
    I’m running the dolphin model locally, it’s an abliterated model which means that it has been fine tuned to not refuse any request and since it is running locally, I also have access to the full output vectors like the researchers used in the experiment.
    
    I replied to another comment, in detail, about the Meta study and how it isn’t remotely close to ‘reproduces a full book when prompted’
    
    In they study they were trying to reproduce 50 token chunks (token is less than a word, so under 50 words) if given the previous 50 tokens. They found that in some sections (around 42% of the ones they tried) they were able to reproduce the next 50 tokens better than 50% of the time.
    
    Reproducing some short sentences from some of a book some of the time is insignificant compared to something like Google Books who will copy the exact snippet of text from their 100% perfect digital copy and show you exact digital copies of book covers, etc.
    
    This research is of interest to the academic study AI in the subfields focused on understanding how models represent data internally. It doesn’t have any significance when talking about copyright.
    
    source
    mfed1122@discuss.tchncs.de ⁨1⁩ ⁨day⁩ ago
    Thank you so much for taking the time to post thorough breakdowns of misleading information using your expertise. And extra beautiful because it goes against the dominant Lemmy circlejerk. I wish there was community full only of such behavior!
    
    source
    MangoCats@feddit.it ⁨2⁩ ⁨days⁩ ago
    
    It doesn’t have any significance when talking about copyright.
    
    I agree, but that doesn’t stop journalists from recognizing a hot button topic and hyper-bashing that button as fast and hard and often as they can.
    
    source