Kimurai is an open source web scraping framework written in Ruby that simplifies the process of building automated data extraction tools. It provides a clean domain-specific language that allows developers to define scraping logic and data schemas with minimal boilerplate code. Kimurai can use AI-assisted extraction to identify where data resides in HTML pages, automatically generating selectors that are cached for future use so subsequent scraping runs operate with pure Ruby performance. Kimurai supports scraping both static and JavaScript-rendered websites by working with multiple engines, including headless browsers and simple HTTP-based approaches. Developers can also interact with pages using browser automation features such as form filling, clicking elements, or navigating through dynamic content. It includes tools for scheduling, parallel scraping, and structured data output, making it suitable for building reliable large-scale crawlers.

Features

  • AI-assisted data extraction that generates reusable XPath selectors
  • Supports headless Chrome, headless Firefox, and HTTP-based scraping engines
  • Ability to scrape JavaScript-rendered pages and dynamic content
  • Built-in helpers for exporting scraped data to JSON, JSON Lines, or CSV
  • Parallel crawling and scheduling support for large scraping tasks
  • Interactive console and debugging tools for developing scraping spiders

Project Samples

kimuraframework Screenshot 1

Project Activity

See All Activity >

Categories

Web Scrapers

License

MIT License

Follow kimuraframework

kimuraframework Web Site

Other Useful Business Software
Turn traffic into pipeline and prospects into customers Icon
Turn traffic into pipeline and prospects into customers

For account executives and sales engineers looking for a solution to manage their insights and sales data

Docket is an AI-powered sales enablement platform designed to unify go-to-market (GTM) data through its proprietary Sales Knowledge Lake™ and activate it with intelligent AI agents. The platform helps marketing teams increase pipeline generation by 15% by engaging website visitors in human-like conversations and qualifying leads. For sales teams, Docket improves seller efficiency by 33% by providing instant product knowledge, retrieving collateral, and creating personalized documents. Built for GTM teams, Docket integrates with over 100 tools across the revenue tech stack and offers enterprise-grade security with SOC 2 Type II, GDPR, and ISO 27001 compliance. Customers report improved win rates, shorter sales cycles, and dramatically reduced response times. Docket’s scalable, accurate, and fast AI agents deliver reliable answers with confidence scores, empowering teams to close deals faster.
Learn More
Rate This Project
Login To Rate This Project

User Reviews

Be the first to post a review of kimuraframework!

Additional Project Details

Operating Systems

Linux, Mac

Programming Language

Ruby, Unix Shell

Related Categories

Unix Shell Web Scrapers, Ruby Web Scrapers

Registered

2026-03-11
Report inappropriate content