• 0 Posts
  • 594 Comments
Joined 2 年前
cake
Cake day: 2023年6月12日

help-circle




  • Really depends on what data it is and whether you want to search it regularly or just as a one time thing.

    You could load them into an rdbms (MySQL/Postgres) and have it handle the indexing, or use python tools to process the files. Something like elasticsearch could work too.

    If it’s just a one time thing grep is probably fine tho.

    Aleph could work as well but I have no experience with it.

    I guess it depends on how much time you want to invest in setting something up versus how much time you’d lose waiting for grep to finish (if you only need to search a certain column, you can create an index with just that column using awk, search that index file, then extract the full line from the source file based on that result, but at that point you’re basically creating a new database engine).













  • Didn’t really get to for ages, but with a steam deck it’s doable to do it after the kid’s in bed to play an hour or 2 of something. You definitely have to pick other types of games than the ones I used to play tho (FPS and RTS don’t really work well with the Steam deck controls).