Function udpos_preprocess has a Cognitive Complexity of 98 (exceeds 5 allowed). Consider refactoring.

Open

def udpos_preprocess(args):
    def _read_one_file(file):
        data = []
        sent, tag, lines = [], [], []
        for line in open(file, 'r'):

• Read up
  Read up

Function Stemmer has a Cognitive Complexity of 58 (exceeds 5 allowed). Consider refactoring.

Open

var Stemmer = function() {

  var step2list = {
    ational: 'ate',
    tional: 'tion',

• Read up
  Read up

Function query has a Cognitive Complexity of 49 (exceeds 5 allowed). Consider refactoring.

Open

  query : function(query) {
    var i;

    // stem the searchterms and add them to the correct list
    var stemmer = new Stemmer();

• Read up
  Read up

Function Deferred has 178 lines of code (exceeds 25 allowed). Consider refactoring.

Open

    Deferred: function( func ) {
        var tuples = [

                // action, add listener, callbacks,
                // ... .then handlers, argument index, [final state]

File utils_preprocess.py has 463 lines of code (exceeds 250 allowed). Consider refactoring.

Open

# coding=utf-8
# Copyright 2020 Google and DeepMind.
#
# Licensed under the Apache License, Version 2.0 (the "License");
# you may not use this file except in compliance with the License.

Function performObjectSearch has a Cognitive Complexity of 45 (exceeds 5 allowed). Consider refactoring.

Open

  performObjectSearch : function(object, otherterms) {
    var filenames = this._index.filenames;
    var docnames = this._index.docnames;
    var objects = this._index.objects;
    var objnames = this._index.objnames;

• Read up
  Read up

Function panx_tokenize_preprocess has a Cognitive Complexity of 40 (exceeds 5 allowed). Consider refactoring.

Open

def panx_tokenize_preprocess(args):
    def _preprocess_one_file(infile, outfile, idxfile, tokenizer, max_len):
        if not os.path.exists(infile):
            print(f'{infile} not exists')
            return 0

• Read up
  Read up

Function Stemmer has 151 lines of code (exceeds 25 allowed). Consider refactoring.

Open

var Stemmer = function() {

  var step2list = {
    ational: 'ate',
    tional: 'tion',

Function udpos_tokenize_preprocess has a Cognitive Complexity of 38 (exceeds 5 allowed). Consider refactoring.

Open

def udpos_tokenize_preprocess(args):
    def _preprocess_one_file(infile, outfile, idxfile, tokenizer, max_len):
        if not os.path.exists(infile):
            print(f'{infile} does not exist')
            return

• Read up
  Read up

Function performTermsSearch has a Cognitive Complexity of 36 (exceeds 5 allowed). Consider refactoring.

Open

  performTermsSearch : function(searchterms, excluded, terms, titleterms) {
    var docnames = this._index.docnames;
    var filenames = this._index.filenames;
    var titles = this._index.titles;

• Read up
  Read up

File searchtools.js has 381 lines of code (exceeds 250 allowed). Consider refactoring.

Open

/*
 * searchtools.js
 * ~~~~~~~~~~~~~~~~
 *
 * Sphinx JavaScript utilities for the full-text search.

Function defaultPrefilter has 122 lines of code (exceeds 25 allowed). Consider refactoring.

Open

function defaultPrefilter( elem, props, opts ) {
    var prop, value, toggle, hooks, oldfire, propTween, restoreDisplay, display,
        isBox = "width" in props || "height" in props,
        anim = this,
        orig = {},

Function Callbacks has 121 lines of code (exceeds 25 allowed). Consider refactoring.

Open

jQuery.Callbacks = function( options ) {

    // Convert options from String-formatted to Object-formatted if needed
    // (we check in cache first)
    options = typeof options === "string" ?

Function query has 121 lines of code (exceeds 25 allowed). Consider refactoring.

Open

  query : function(query) {
    var i;

    // stem the searchterms and add them to the correct list
    var stemmer = new Stemmer();

Function DataloaderSC has a Cognitive Complexity of 31 (exceeds 5 allowed). Consider refactoring.

Open

def DataloaderSC(lang_list,
                model_name_or_path,
                model_type,
                mode_list,
                data_dir,

• Read up
  Read up

Function _keep_fused_form has a Cognitive Complexity of 31 (exceeds 5 allowed). Consider refactoring.

Open

    def _keep_fused_form(self,posPreferenceDicts):
        # For a span A,B  and external tokens C, such as  A > B > C, we have to
        # Make A the head of the span
        # Attach C-level tokens to A
        #Remove B-level tokens, which are the subtokens of the fused form della: de la

• Read up
  Read up

Function stemWord has 109 lines of code (exceeds 25 allowed). Consider refactoring.

Open

  this.stemWord = function (w) {
    var stem;
    var suffix;
    var firstch;
    var origword = w;

Function then has 102 lines of code (exceeds 25 allowed). Consider refactoring.

Open

                then: function( onFulfilled, onRejected, onProgress ) {
                    var maxDepth = 0;
                    function resolve( depth, deferred, handler, special ) {
                        return function() {
                            var that = this,

Function read_conll_u has a Cognitive Complexity of 27 (exceeds 5 allowed). Consider refactoring.

Open

    def read_conll_u(self,filename,keepFusedForm=False, lang=None, posPreferenceDict=None):
        sentences = []
        sent = DependencyTree()
        multi_tokens = {}

• Read up
  Read up

Function Animation has 96 lines of code (exceeds 25 allowed). Consider refactoring.

Open

function Animation( elem, properties, options ) {
    var result,
        stopped,
        index = 0,
        length = Animation.prefilters.length,