User-level | Option | Description | Free | Premium |
---|---|---|---|---|
Beginner | Easy Excel-Like Interface | Familiar interface, similar to what you already know: Excel. Includes drag-and-drop functionality | X | X |
Beginner | Quick-Action Interface | Common, one-click action templates | X | X |
Advanced | Advanced Interface | Features designed for experts that help maximize both control and efficiency. Includes drag-and-drop functionality | X | X |
Beginner | Simplified-Interface Toggle | Show or hide advanced options to customize your experience | X | X |
Beginner | Link Grabber | One-click action template to extract all links on a web page | X | X |
Beginner | Email Grabber | One-click action template to extract all emails on a web page | X | X |
Beginner | Extraction Customizer | Extract entire web pages or specific portions of source code. Quickly send data to Batch Data Collector by right-clicking your mouse | X | |
Beginner | Inspector | Visually compose your final file, and easily capture the right web elements thanks to our point-and-click guide | X | X |
Beginner | Sound and Alerts | Customize sounds for key events such as completing a list, scan rate, or general warnings | X | |
Beginner | Custom Recipes | Define what information you want to source from a web page, including custom pointers and recipe actions | X | X |
Advanced | DOM and Text Recipe Creation | Define specific fields to extract by indicating the text or source code that contains what you want. Or, for better performance, indicate the CSS selector | X | X |
Beginner | Save Recipes & Safe Recipes | Premium subscribers can save recipes within Batch Data Collector. All transmissions are guaranteed by SSL encryption | X | |
Beginner | Save Custom Recipes | Save up to 10 or unlimited custom recipes and reuse them as you like | X | |
Advanced | Source -, Actual- & Redirect-URL | Extract environmental parameters of the web page, such as the source-URL, actual-URL after a redirection, domain name, or the language of the visible text | Partially | X |
Expert | Custom tag types to acquire | Search among each HTML standard and non-standard tag attributes, or delve into Script code blocks. | X | X |
Advanced | Data Trimming and Cleaning | Clean data of unwanted white space or strip the HTML code | X | X |
Advanced | Data Exclusion | Define key data validation parameters, such as rejecting fields with undesirable information or only accepting information if it matches your specific criteria | X | X |
Expert | Set Recipe Actions | Customize cycles of actions or create “loops” to allow incredibly complex sequences of events to be performed before and after data extraction. | Basic Actions Only | X |
Advanced | Auto-Detect page Events | Search underlying web page source code for links, buttons, and hidden events. This helps activate or suppress page triggers from a custom recipe | X | X |
Beginner | Data Export Preview | Review collected information in Preview Mode, in HTML (table or code), in CSV code, and in JSON prior to export | X | X |
Beginner | Native Data Export | Export into XLSx and CSV locally. Nothing you collect ever hits our servers | X | X |
Advanced | Batch Navigation | Create powerful multi-recipe tasks in a single navigation campaign. Auto-browse lengthy URL lists, specify a “Discard List,” and retrieve a final list of pages that yielded no results | X | |
Advanced | Multi-tab Browsing | Choose the number of tabs to simultaneously open (up to 10) at a time. For sizable navigation campaign, this could greatly reduce wait times and accelerate productivity, allowing future pages to open while the current pages are extracting | X | |
Advanced | Navigation Pauses | Set custom pauses between page opens, after a certain number of results are extracted, or after a disconnection event and/or absence of desirable results | X | |
Advanced | Forced Timeout | Intentionally suppress pages that aren’t responding to keep your navigation campaign moving along without impeding your progress due to a fussy page or bad URL | X | |
Advanced | Reduce noise, speed-up your browser | Filter images, disable cascading-style sheets, block multimedia objects, or block Javascript | X | |
Expert | Send Data to an External Server | Send real-time data to an external server in JSON while executing a navigation campaign. Each recordset is defined by the column headings in your recipe. | X | |
Expert | Customize Exports to External Server | Specify additional parameters to be sent, such as a token. Detect each server response (successful, unsuccessful), and program any additional dispatch attempts to be made | X | |
Advanced | Processor Throttling | Set an ideal level of processor effort. Lighter work-mode allows you to continue working while sourcing data in the background | X | |
Advanced | Rotate User Agents | Randomize your request header to emulate a different browser or computer after each page visited | X | |
Advanced | Aggregate Data by Column | Select an aggregation column. Your grouping criteria will be applied upon extraction | X | |
Advanced | Basic Text Manipulation | Add prefixes or suffixes to a selected portion of text and isolate strings between two sentences | X | X |
Advanced | String Search and Regular Expression Compatibility | Keyword search within strings or source code. Use the power of RegExp to define complex search patterns | X | |
Advanced | String Replacement | Replace one or more strings from the isolated source code to refine your results. Both single replacement and multi-replacement (with character separator) functionality allowed | X | |
Advanced | Download individual resources as a file | Locally download pictures, HTML pages, or more. All versions include our configurable download manager | X | X |
Advanced | Parse as JSON | Browse portions of code, parsing them as a JSON array to grab the exact nodes you are looking for | X | |
Advanced | Download full web pages | Save web page content in MHTML, incorporating external resources, such as images, applets, animations, etc. | X | X |
Advanced | Go to next page | Identify or detect next page buttons and auto-surf until a next page no longer exists | X | X |
Advanced | Vertical page auto-scrolling | Scroll down the page automatically and extract data from rendered new page blocks only. Eventually frees the unused memory dedicated to previous page blocks | X | X |
Advanced | Repeat Until... | Reiterates action event list as many times as specified | X | X |
Expert | Collect unvisited links | Generate a list of unique unvisited URLs, extracting them from specific sections of the web page. All links will be navigated during a batch process | X | |
Expert | IF Condition(s) | Design complex workflows based on the visible text content or hidden source code of a page. Multiple AND and OR conditions can be grouped together | X | |
Expert | Viewport Live Code Replacement | Replace or push portions of source code directly to the active browser viewport. Web page architecture can be manipulated extensively, hacking predefined rules designed by a site publisher | X | |
Expert | Code Suppression | Set rules to partially or fully erase portions of web page source code. Some websites are intentionally code-heavy - this should help you lighten the load | X | |
Expert | Autocomplete Rules | Automatically fill forms and create sub-loops of actions to interact with buttons, textfields, checkboxes, radio buttons, and more. | X | |
Expert | Extract Data and Clean Memory | Preconfigure a memory wipe after each successful data extraction to XLSx to help keep your browser nimble | X | |
Expert | Restore Data | Should your browser crash mid-extraction, automated data recovery minimizes the need to start from scratch | X |
More to come..
We’re not done developing BdC and FdC! Reach out to us if you have any questions or great ideas.