Sign upLogin

ipfs-search/ipfs-search

View on GitHub
Star
docs/towards_dist_search/Distributed_search.md

Summary

Maintainability
Test Coverage

Unexpected trailing spaces found.
Open

-   This local index is put on an (IPFS) cluster.
Severity: Minor
Found in docs/towards_dist_search/Distributed_search.md by editorconfig

Unexpected trailing spaces found.
Open
Severity: Minor
Found in docs/towards_dist_search/Distributed_search.md by editorconfig

Unexpected trailing spaces found.
Open

-   Tokenise the query (split into words)
Severity: Minor
Found in docs/towards_dist_search/Distributed_search.md by editorconfig

Unexpected trailing spaces found.
Open

    -   Number of downloaded bytes per second versus the number of peers
Severity: Minor
Found in docs/towards_dist_search/Distributed_search.md by editorconfig

Unexpected trailing spaces found.
Open

    -   Bring the downed node back online. The data that belongs on this node (hopefully) begins to flow back into the node.
Severity: Minor
Found in docs/towards_dist_search/Distributed_search.md by editorconfig

Unexpected trailing spaces found.
Open

-   [IPFS Cluster Documentation](https://cluster.ipfs.io/documentation/ "https://cluster.ipfs.io/documentation/")
Severity: Minor
Found in docs/towards_dist_search/Distributed_search.md by editorconfig

Unexpected trailing spaces found.
Open

-   Sanitize the query (stemming all the words, making all letters lowercase, removing punctuation)
Severity: Minor
Found in docs/towards_dist_search/Distributed_search.md by editorconfig

Unexpected tabs found.
Open

        return [filename for filename in invertedIndex[word].keys()]
Severity: Minor
Found in docs/towards_dist_search/Distributed_search.md by editorconfig

Unexpected tabs found.
Open

        listOfLists.append(one_word_query(word))
Severity: Minor
Found in docs/towards_dist_search/Distributed_search.md by editorconfig

Unexpected tabs found.
Open

    setted = set(listOfLists[0]).intersection(*listOfLists)
Severity: Minor
Found in docs/towards_dist_search/Distributed_search.md by editorconfig

Unexpected tabs found.
Open

    for filename in setted:
Severity: Minor
Found in docs/towards_dist_search/Distributed_search.md by editorconfig

Unexpected trailing spaces found.
Open

-   Node failure
Severity: Minor
Found in docs/towards_dist_search/Distributed_search.md by editorconfig

Unexpected trailing spaces found.
Open

-   No local discovery.
Severity: Minor
Found in docs/towards_dist_search/Distributed_search.md by editorconfig

Unexpected trailing spaces found.
Open

-   [Tika Supported Document Formats](https://tika.apache.org/1.4/formats.html "https://tika.apache.org/1.4/formats.html")
Severity: Minor
Found in docs/towards_dist_search/Distributed_search.md by editorconfig

Unexpected trailing spaces found.
Open

-   IPFS does not guarantee redundancy. We can use IPFS clustering.
Severity: Minor
Found in docs/towards_dist_search/Distributed_search.md by editorconfig

Unexpected tabs found.
Open

    string = pattern.sub(' ',string)
Severity: Minor
Found in docs/towards_dist_search/Distributed_search.md by editorconfig

Unexpected tabs found.
Open

    for word in string.split():
Severity: Minor
Found in docs/towards_dist_search/Distributed_search.md by editorconfig

Unexpected tabs found.
Open

        temp = []
Severity: Minor
Found in docs/towards_dist_search/Distributed_search.md by editorconfig

Unexpected trailing spaces found.
Open

    -   Number of hashes crawled per second per-peer versus the number of peers
Severity: Minor
Found in docs/towards_dist_search/Distributed_search.md by editorconfig

Unexpected trailing spaces found.
Open

    walk through the directory structure to fetch each file_path and
Severity: Minor
Found in docs/towards_dist_search/Distributed_search.md by editorconfig

Unexpected trailing spaces found.
Open
Severity: Minor
Found in docs/towards_dist_search/Distributed_search.md by editorconfig

Unexpected tabs found.
Open

    if word in invertedIndex.keys():
Severity: Minor
Found in docs/towards_dist_search/Distributed_search.md by editorconfig

Unexpected tabs found.
Open

    string = pattern.sub(' ',string)
Severity: Minor
Found in docs/towards_dist_search/Distributed_search.md by editorconfig

Unexpected trailing spaces found.
Open

    -   After a while, pull the data from the agent to check that data that was sent to its neighbours when it was down is stored correctly.
Severity: Minor
Found in docs/towards_dist_search/Distributed_search.md by editorconfig

Expected a newline at the end of the file.
Open

### [Source](https://niverel.tymyrddin.space/en/play/stones/upsidedown/testing)
Severity: Minor
Found in docs/towards_dist_search/Distributed_search.md by editorconfig

Unexpected trailing spaces found.
Open

-   Provider nodes that wish to participate, parse and index only the files they have added to a dweb (DHT hashes) and that have world file permissions.
Severity: Minor
Found in docs/towards_dist_search/Distributed_search.md by editorconfig

Unexpected trailing spaces found.
Open
Severity: Minor
Found in docs/towards_dist_search/Distributed_search.md by editorconfig

Unexpected trailing spaces found.
Open
Severity: Minor
Found in docs/towards_dist_search/Distributed_search.md by editorconfig

Unexpected tabs found.
Open

    pattern = re.compile('[\W_]+')
Severity: Minor
Found in docs/towards_dist_search/Distributed_search.md by editorconfig

Unexpected trailing spaces found.
Open

-   Scalability indicators
Severity: Minor
Found in docs/towards_dist_search/Distributed_search.md by editorconfig

Unexpected trailing spaces found.
Open

    -   Take an agent offline (check that it has gone down and is inaccessible) and verify that all the data appears to be working.
Severity: Minor
Found in docs/towards_dist_search/Distributed_search.md by editorconfig

Unexpected tabs found.
Open

        for i in range(len(temp)):
Severity: Minor
Found in docs/towards_dist_search/Distributed_search.md by editorconfig

Unexpected additional newlines at the end of the file.
Open

### [Source](https://niverel.tymyrddin.space/en/play/stones/upsidedown/testing)
Severity: Minor
Found in docs/towards_dist_search/Distributed_search.md by editorconfig

Unexpected tabs found.
Open

        return []
Severity: Minor
Found in docs/towards_dist_search/Distributed_search.md by editorconfig

Unexpected tabs found.
Open

    result = []
Severity: Minor
Found in docs/towards_dist_search/Distributed_search.md by editorconfig

Unexpected trailing spaces found.
Open

-   Performance indicators
Severity: Minor
Found in docs/towards_dist_search/Distributed_search.md by editorconfig

Unexpected tabs found.
Open

        result += one_word_query(word)
Severity: Minor
Found in docs/towards_dist_search/Distributed_search.md by editorconfig

Unexpected tabs found.
Open

            for ind in range(len(temp[i])):
Severity: Minor
Found in docs/towards_dist_search/Distributed_search.md by editorconfig

Unexpected tabs found.
Open

        for word in string.split():
Severity: Minor
Found in docs/towards_dist_search/Distributed_search.md by editorconfig

Unexpected tabs found.
Open

        if set(temp[0]).intersection(*temp):
Severity: Minor
Found in docs/towards_dist_search/Distributed_search.md by editorconfig

Unexpected trailing spaces found.
Open

    -   If automated, this may require adding data entry points in the API that are only used for testing.
Severity: Minor
Found in docs/towards_dist_search/Distributed_search.md by editorconfig

Unexpected trailing spaces found.
Open

-   Only popular indexes will be able to get a decent speed.
Severity: Minor
Found in docs/towards_dist_search/Distributed_search.md by editorconfig

Unexpected tabs found.
Open

    pattern = re.compile('[\W_]+')
Severity: Minor
Found in docs/towards_dist_search/Distributed_search.md by editorconfig

Unexpected tabs found.
Open

    return list(set(result))
Severity: Minor
Found in docs/towards_dist_search/Distributed_search.md by editorconfig

Unexpected tabs found.
Open

    for word in string.split():
Severity: Minor
Found in docs/towards_dist_search/Distributed_search.md by editorconfig

Unexpected trailing spaces found.
Open

    -   We can run a few web agent type ipfs nodes in a cluster that pin all the indexes. Give these enough bandwidth and we have some basis nodes that can act as mirrors and can also be served via HTTPS (the internet-facing demo version).
Severity: Minor
Found in docs/towards_dist_search/Distributed_search.md by editorconfig

Unexpected tabs found.
Open

            result.append(filename)
Severity: Minor
Found in docs/towards_dist_search/Distributed_search.md by editorconfig

Unexpected trailing spaces found.
Open

-   No transports other than, for example, via Tor (an overlay network consisting of more than seven thousand relays to conceal a user's location and usage from anyone conducting network surveillance or traffic analysis).
Severity: Minor
Found in docs/towards_dist_search/Distributed_search.md by editorconfig

Unexpected tabs found.
Open

    else:
Severity: Minor
Found in docs/towards_dist_search/Distributed_search.md by editorconfig

Unexpected tabs found.
Open

            temp.append(invertedIndex[word][filename][:])
Severity: Minor
Found in docs/towards_dist_search/Distributed_search.md by editorconfig

Unexpected trailing spaces found.
Open

    -   Number of hashes crawled per second versus different CPU loads/platforms
Severity: Minor
Found in docs/towards_dist_search/Distributed_search.md by editorconfig

Unexpected trailing spaces found.
Open

-   Predictive analysis
Severity: Minor
Found in docs/towards_dist_search/Distributed_search.md by editorconfig

Unexpected tabs found.
Open

    return rankResults(result, string)
Severity: Minor
Found in docs/towards_dist_search/Distributed_search.md by editorconfig

Unexpected trailing spaces found.
Open
Severity: Minor
Found in docs/towards_dist_search/Distributed_search.md by editorconfig

Unexpected trailing spaces found.
Open
Severity: Minor
Found in docs/towards_dist_search/Distributed_search.md by editorconfig

Unexpected tabs found.
Open

                temp[i][ind] -= i
Severity: Minor
Found in docs/towards_dist_search/Distributed_search.md by editorconfig

Unexpected trailing spaces found.
Open

-   [Yggdrasil Version 0.3.6](https://yggdrasil-network.github.io/2019/08/03/release-v0-3-6.html "https://yggdrasil-network.github.io/2019/08/03/release-v0-3-6.html"), august 2019, first version with API
Severity: Minor
Found in docs/towards_dist_search/Distributed_search.md by editorconfig

Unexpected trailing spaces found.
Open

    -   Throughput of a peer versus the number of crawled job queues (to determine the optimal number of crawl job queues) per platform (differentiate using agent attributes).
Severity: Minor
Found in docs/towards_dist_search/Distributed_search.md by editorconfig

Unexpected tabs found.
Open

    word = pattern.sub(' ',word)
Severity: Minor
Found in docs/towards_dist_search/Distributed_search.md by editorconfig

Unexpected tabs found.
Open

    pattern = re.compile('[\W_]+')
Severity: Minor
Found in docs/towards_dist_search/Distributed_search.md by editorconfig

Unexpected tabs found.
Open

    listOfLists, result = [],[]
Severity: Minor
Found in docs/towards_dist_search/Distributed_search.md by editorconfig

There are no issues that match your filters.

Category
Status