• CriticalResist8@lemmygrad.mlOP
    link
    fedilink
    arrow-up
    7
    ·
    4 days ago

    We actually just finished uploading all of ProleWiki FR, from prolewiki EN. Total time was 7 days. There’s a total of 3750 pages uploaded already, and we’ll bring the Library books soon too (they’re still translating).

    Total LLM involvement was writing the scripts and handling the translation. And it’s a pretty nice script too, it cuts each page into chunks, sends them to the LLM with a system prompt, saves progress after each chunk, automatically retries if the API fails… if I’d learned python specifically for this I would still be trying to write that code.

    “But could you have translated them yourself”, some might say, and yes but we’re 3 sleep-deprived tankies and this is a machine that runs 24/7 haha

    • ☆ Yσɠƚԋσʂ ☆@lemmygrad.ml
      link
      fedilink
      arrow-up
      7
      ·
      edit-2
      4 days ago

      It’s such a great real world example of how LLMs are a practical tool in the class struggle. What would have been a Herculean, if not impossible, task for a small team is now achievable in automated fashion within a week. By automating the grunt work of translation and content creation, these tools allow us to break the cultural hegemony of the ruling class and rapidly build our own ideological infrastructure. We are now able to contest the bourgeois narrative on a scale that was previously simply not possible.