Registrieren

Registierung erfolgt in Kürze...
Fleebs-Logo
Details werden geladen...

Building a Local Search Index for a 200MB X Archive - DEV Community

The archive arrives as a ZIP and tweets.js inside it often runs to a few hundred megabytes. Finding the one address you mentioned three years ago is not a text-editor job. A short script turns the archive into a searchable local index, plus why memory blows up when you stream the file the naive way.