While this will get you a selfhosted LLM it is not possible to feed data to them like this. As far as I know there are a 2 possibilities:
-
Take an existing model and use the literature data to fine tune the model. The success of this will depend on how much “a lot” means when it comes to the literature
-
Create a model yourself using only your literature data
Both approaches will require some yrogramming knowledge and understanding of how a llm works. Additionally it will require a preparation of the unstructured literature data to a kind of structured data that can be used to train or fine tune the model.
Im just a CS student so not an expert in this regard ;)
I don’t think that is even necessary. If you download the .torrent file from a trusted source it will already contain a secure hash of the final file. Also every piece you receive also comes with a hash that can also be verified through the .torrent file. If you don’t trust the source enough to provide a valid .torrent, I don’t see how downloading the image directly from them makes any difference. Read more: Official BitTorrent BEP BitTorrent V2 and SHA-256