Comment on Hister: a private search engine

conrad82@lemmy.world ⁨1⁩ ⁨day⁩ ago

• conrad82@lemmy.world ⁨1⁩ ⁨day⁩ ago

  I have tried it a bit today and I like it, but I have a few questions

  • Is it better to run it in docker or e.g. a LXC in proxmox? If i want to index files, it seems it needs the config.yml file
  • After just playing with it for a day, the disk usage is 150 MB. I figure I should use postgres instead of sqlite. Do you have any examples on how to set that up, preferably with docker? I guess I can figure it out, but it might take me some time. I am not familiar with pgvector

  original

  • asciimoo@lemmy.ml ⁨23⁩ ⁨hours⁩ ago

    can i connect it to other services like paperless, or would i need to manually import files?

    Hister supports importing data from a few services, but paperless isn’t supported yet. More details: hister.org/docs/import

    Is it better to run it in docker or e.g. a LXC in proxmox? If i want to index files, it seems it needs the config.yml file

    Docker is perfectly fine. Every settings option from the config file can specified using environment variables. The syntax is HISTER__[SECTION]__[OPTION]=[VALUE].

    After just playing with it for a day, the disk usage is 150 MB

    Probably most of the disk space is occupied by the Hister binary which contains all the N-grams required to identify ~30 languages. The index should be much smaller.

    I figure I should use postgres instead of sqlite.

    SQLite is more than enough for personal use, but if you prefer to use postgres, just specify the standard DSN formatted connection data to the server.database config option: hister.org/docs/configuration#database-backends

    how to set that up, preferably with docker

    Use the HISTER__SERVER__DATABASE=“host=localhost user=hister password=hister dbname=hister port=5432” environment variable.

    I am not familiar with pgvector

    Hister automatically creates the database model and handles the migrations if required.

    original

    • conrad82@lemmy.world ⁨16⁩ ⁨hours⁩ ago

      Thank you for your response 🙂 I will stick to sqlite

      How do i use environment variables to make a indexer? I couldn’t get it to work

      i.e. the part with directories hister.org/…/indexing-local-files-with-hister

      indexer:
        directories:
          - path: ~/Documents
            filetypes: ['md', 'txt']
          - path: ~/code/projects
            filetypes: ['txt']
            excludes: [, 'secret/*', '*key']
          - path: ~/notes
            patterns: ['*.org', 'doc_*', 'README']
      

      original

      • asciimoo@lemmy.ml ⁨13⁩ ⁨hours⁩ ago

        How do i use environment variables to make a indexer? I couldn’t get it to work

        Repeatable config options are not supported from env vars. In this case you have to mount a config file to your container. But, if you want to track local files from docker, you have to mount those files/directories anyway. I suggest to use the standalone binary release if you’d like to track local files, it is way more convenient.

        original