Automate That Shit!

Automate That Shit alternatives

  • Scrapy

  • Scrapy is an open source and collaborative framework for extracting the data you need from websites. In a fast, simple, yet extensible way.

    tags: framework data-mining web-scraping
  • import.io

  • import.io is a free web-based platform that puts the power of the machine readable web in your hands. Using our tools you can create an API or crawl an entire website in a fraction of the time of traditional methods, no coding required. Our highly efficient and scalable platform allows you to process 1,000s of queries at once and get real-time data in any format you choose. We also offer an easy to use client library to make exporting, integrating and using your data as simple as extracting it.

    tags: data-mining data-extraction extractor crawler data-export
  • Browsershots

  • Browsershots makes screenshots of your web design in different browsers. It is a free open-source online service created by Johann C. Rocholl. When you submit your web address, it will be added to the job queue. A number of distributed computers will open your website in their browser. Then they will make screenshots and upload them to the central server here.

    tags: cross-browser-testing python web-development
  • PDF my URL

  • PDFmyURL.com will turn any webpage into a PDF file instantly.

    tags: pdf pdf-conversion pdf-creator
  • DiffEngineX

  • DiffEngineX is a fast utility that finds the differences between the formulae, constants, defined names, cell comments and Visual Basic code contained in either two whole Excel workbooks (*.xls, *.xlsx, *.xlsm, *.xlsb) or selected worksheets. It generates a cell-by-cell difference report in a new workbook and color highlights different cells in automatically made copies of your workbooks.

    tags: excel-comparison spreadsheet-comparison
  • CONV.

  • Quickly convert any YouTube video to MP3, GIF or MP4.

    tags: conv youtube-converter youtube-downloader youtube-to-gif youtube-to-mp3
  • HTML2PDF

  • HTML2PDF is a HTML to PDF converter that allows the conversion of valid HTML 4.01 in PDF format, and is distributed under LGPL.

    tags: api html-to-pdf php-application
  • grabicon

  • Grabicon - Simple Favicon Finder API

    tags: api extract-icon find-icons icon-converter favicon.ico
  • Scrapinghub

  • Scrapinghub is the most advanced platform for deploying and running web crawlers (also known as "spiders"). It allows your organization to build crawlers easily, deploy them instantly and scale them on demand, without having to manage servers, backups or cron jobs. Everything is stored in our highly available database and retrievable from our API.

    tags: web-based data-mining company web-scraper
  • PDFcrowd

  • Pdfcrowd lets you convert HTML to PDF online. Create PDF from HTML or web pages directly in your browser or in your Python, Ruby, .NET, Java, PHP apps via our API.

    tags: convert-html-to-pdf html-to-pdf-api
  • giflayer API

  • The giflayer API was built to provide a powerful and simple way to perform Video to GIF Conversion at an unparalleled speed and a quality of up to 30 FPS (Frames per Second), supporting all major video portals (e.g. YouTube, Vimeo, Vine, ... ), direct video links and video file formats.

    tags: productivity-tool saas-for-business url-to-gif url-to-gif-php video-to-gif
  • Batch RegEx

  • Replace, format, and extract text in multiple files using Regular Expressions.- Perform GREP-like tasks including search and replace, RegEx substitutions, data extraction, and more!- Built-in RegEx editors support color syntax highlighting and contextual tooltips making it easy to design patterns.- Specialized RegEx tools like html/xml tag selector, line selector, or number selector help you make RegEx patterns faster.- Integrated RegEx Builder helps with testing your RegEx patterns by letting you perform search and replace operations on sample text and automatically highlighting matches.- Program supports numerous text transformations that can be performed on text matched by your RegEx patterns.- Some text transforms include: change letter case; trim; reverse order of characters; sort list; shuffle list; remove duplicates; compute hash; encrypt/decrypt; URL encode/decode; Morse code converter; escape/unescape string; operations with numbers (matched text is treated as a number that you can then change); etc.- Process 1000s of files using multiple CPU cores in manual, automatic/continuous, triggered/scheduled, or console modes, or directly from Windows Explorer right-click menu.- Save files to output directory specified using either absolute or relative path, with original or new name defined by a mask.- Select files for processing based on their name, dates, size, and contents using advanced file search supporting RegEx and advanced wildcards.- Optionally merge together, split all, or zip processed files.- Perform different operations on different files with conditional processing and process branching.- Complete support for Regular Expressions (RegEx) and Unicode throughout the program.- Detailed processing logs are available in both user interface and log files.- Run multiple program instances simultaneously. »

    tags: Portable automation batch-processing extract-text grep
  • Web Contact Scraper

  • Web Contact Scraper is a fully automated software application for gathering targeted business contact information!

    tags: Portable marketing email-marketing marketing-tools email-campaign
  • Diggernaut

  • Diggernaut is a cloud based service for web scraping, data extraction and other ETL tasks. Imagine spending hours a day manually collecting data from websites you need. It's very cumbersome and time consuming. With Diggernaut, you can speed up the data collection process a thousand times and save time to do more important tasks. Our tiny diggers can do web scraping on your behalf and get data from websites for you. Just leave it up to Diggernaut to get your job done.

    tags: big-data data-mining web-scraping etl web-scraper
  • Web Robots

  • Web Robots have several offers and tools:- For users without programming skills. A Chrome extension which guesses where is listing type data on a web page and coverts this data into CSV or Excel file.- For users with Javascript programming skills. Another Chrome extension which is an Integrated Development Environment to write and execute scraper robots. This allows running robots with all features on user's computer for free.- For companies. Web Robots can provide a fully managed data scraping service or license access to the whole platform where client can create and schedule robots, run them on cloud. »

    tags: web-scraping web-scraper web-scraping-tools web-scraping-software webdata