Function collect has a Cognitive Complexity of 47 (exceeds 5 allowed). Consider refactoring.

Open

    collect() {
        // Preserve our reference to 'this'
        const self = this;
        // Get a list of app IDs
        const appIds = _.keys(self.apps);

• Read up
  Read up

Function collect has 135 lines of code (exceeds 25 allowed). Consider refactoring.

Open

    collect() {
        // Preserve our reference to 'this'
        const self = this;
        // Get a list of app IDs
        const appIds = _.keys(self.apps);

File index.js has 272 lines of code (exceeds 250 allowed). Consider refactoring.

Open

'use strict';

const Crawler = require('node-webcrawler');
const cheerio = require('cheerio');
const _ = require('lodash');

Function parse has 49 lines of code (exceeds 25 allowed). Consider refactoring.

Open

        function parse(result) {
            const html = responseToHtml(result);
            if (typeof html === 'undefined') {
                // We got an invalid response
                requeue();

Function htmlToReviews has 34 lines of code (exceeds 25 allowed). Consider refactoring.

Open

function htmlToReviews(html, appId, pageNum, emit) {
    try {
        const $ = cheerio.load(html);
        const reviewObjs = $('.single-review');
        const reviews = [];

Function constructor has 32 lines of code (exceeds 25 allowed). Consider refactoring.

Open

    constructor(apps, options) {
        if (options && options.maxPages && options.checkBeforeContinue) {
            console.error('Warning: The \'maxPages\' option will be ignored when \'checkBeforeContinue\' is present');
        }
        const defaults = {

Function responseToHtml has a Cognitive Complexity of 9 (exceeds 5 allowed). Consider refactoring.

Open

function responseToHtml(response) {
    if (response.headers['content-type'] === 'application/json; charset=utf-8') {
        try {
            const decoded = decodeUnicode(decodeUTF8(response.body));
            const body = JSON.parse(removeLeadingChars(decoded));

• Read up
  Read up

Avoid too many return statements within this function.

Open

    return undefined;