Comment on Hister: a private search engine

• asciimoo@lemmy.ml ⁨23⁩ ⁨hours⁩ ago

  can i connect it to other services like paperless, or would i need to manually import files?

  Hister supports importing data from a few services, but paperless isn’t supported yet. More details: hister.org/docs/import

  Is it better to run it in docker or e.g. a LXC in proxmox? If i want to index files, it seems it needs the config.yml file

  Docker is perfectly fine. Every settings option from the config file can specified using environment variables. The syntax is HISTER__[SECTION]__[OPTION]=[VALUE].

  After just playing with it for a day, the disk usage is 150 MB

  Probably most of the disk space is occupied by the Hister binary which contains all the N-grams required to identify ~30 languages. The index should be much smaller.

  I figure I should use postgres instead of sqlite.

  SQLite is more than enough for personal use, but if you prefer to use postgres, just specify the standard DSN formatted connection data to the server.database config option: hister.org/docs/configuration#database-backends

  how to set that up, preferably with docker

  Use the HISTER__SERVER__DATABASE=“host=localhost user=hister password=hister dbname=hister port=5432” environment variable.

  I am not familiar with pgvector

  Hister automatically creates the database model and handles the migrations if required.

  original

  • conrad82@lemmy.world ⁨16⁩ ⁨hours⁩ ago

    Thank you for your response 🙂 I will stick to sqlite

    How do i use environment variables to make a indexer? I couldn’t get it to work

    i.e. the part with directories hister.org/…/indexing-local-files-with-hister

    indexer:
      directories:
        - path: ~/Documents
          filetypes: ['md', 'txt']
        - path: ~/code/projects
          filetypes: ['txt']
          excludes: [, 'secret/*', '*key']
        - path: ~/notes
          patterns: ['*.org', 'doc_*', 'README']
    

    original

    • asciimoo@lemmy.ml ⁨13⁩ ⁨hours⁩ ago

      How do i use environment variables to make a indexer? I couldn’t get it to work

      Repeatable config options are not supported from env vars. In this case you have to mount a config file to your container. But, if you want to track local files from docker, you have to mount those files/directories anyway. I suggest to use the standalone binary release if you’d like to track local files, it is way more convenient.

      original