Road Map - michaeltelford/wgit GitHub Wiki

Raise an issue if you have a feature request.

Nothing below is set in stone (until it's been implemented) and the order doesn't matter. Primary and Secondary refer to the importance of the change, not the amount of work or even when it'll be implemented. If in doubt, reach out and ask!

Primary

  • ...

Secondary

  • Honour robots.txt Crawl-delay parameter for all index_* methods.

Refactoring

  • Use refine instead of core_ext.

Experiments

  • Try out lightweight alternatives to nokogiri e.g. ox, rexml etc. How much lighter are they as a dep? How much faster - benchmark? How much code needs changed? Do they provide as much functionality? Do they require native C extensions?
  • Consider removing ferrum and mongo gems from gemspec, requiring users to stall them explitely if using that functionality. This would require changing the default database adapter to be InMemory and updating the docs accordingly.
  • Write a DB adapter for the Qdrant vector DB, which would provide semantic search capabilities (instead of just plain text).