retoor/searxng
1
0
Fork 0
Code Issues Pull Requests Actions Packages Projects Releases Wiki Activity
3,802 Commits 6 Branches 17 Tags
c2646df496565bbf66ecfa6baf9cedee1de416cf
Commit Graph
100 Commits
This Branch
This Branch
All Branches
Author SHA1 Message Date
Alexandre Flament c2646df496 Merge pull request #2454 from MarcAbonce/fix-empty-lang-bang 
Fix empty colon in query from selecting Chinese
 2021-01-10 11:01:32 +01:00
Alexandre Flament 485380cd3e Merge pull request #2447 from unixfox/issue-template-notice 
add notice for the issue templates
 2021-01-08 09:30:23 +01:00
Alexandre Flament 5225c4f253 Merge pull request #2448 from return42/fix-1998 
[fix] Library Genesis links shifted by 1 #1998
 2021-01-08 09:29:36 +01:00
Alexandre Flament 14a395a671 Merge pull request #2445 from searx/unixfox-patch-1 
Remove voat due to its shutdown
 2021-01-06 14:06:49 +01:00
Alexandre Flament fb4e6080ed Merge pull request #2428 from dalf/update-dependencies 
[upd] update Python dependencies
 2021-01-05 16:42:51 +01:00
Alexandre Flament 5b58f6a7f8 Merge pull request #2435 from return42/fix-lxc-env 
[LXC] replace ubu1910 image by ubu2010 image
 2021-01-05 16:41:13 +01:00
Alexandre Flament 54e69d0367 [upd] update dependencies 
minor change in the oscar theme becase the last version of jinja2
respect more carefully the spaces in the templates
 2020-12-28 09:04:39 +01:00
Alexandre Flament 5fb9a5c7c1 Merge pull request #2411 from dalf/update-secret-key-check 
Update secret key check
 2020-12-27 18:04:53 +01:00
Alexandre Flament 5840499bfb Merge pull request #2423 from return42/mod1-boilerplate 
Speed up PyLint & revert obsolete CSS issue
 2020-12-27 14:12:56 +01:00
Alexandre Flament 568b9465e9 [mod] check secret_key when searx.webapp is imported 
Without this commit the module searx checks the secret_key value.

With this commit, make docs, utils/standalone_searx.py,
utils/fetch_firefox_version.py works without SEARX_DEBUG=1

For reference see https://github.com/searx/searx/pull/2386
 2020-12-27 10:30:20 +01:00
Alexandre Flament eb1b5289d5 [mod] documentation: change the jinja context doesn't depend on searx.webapp 
Before this commit, in the documentation, the jinja context is 'webapp' and contains
the global variable in the searx.webapp module.

This commit changes this to include only the mandatory variables to build the
documentation.
 2020-12-27 10:00:35 +01:00
Alexandre Flament 1ba53e6129 Merge pull request #2420 from return42/fix-sphinx-book-targets 
fix makefile `books/{name}.*` targets and add documentation about these targets
 2020-12-27 09:47:49 +01:00
Alexandre Flament 1956ab4b50 Merge pull request #2412 from dalf/update-buildenv 
[fix] update buildenv
 2020-12-27 08:31:23 +01:00
Alexandre Flament 48b4af1e08 Merge pull request #2421 from return42/mod-pyenvinstall 
[perf] optimize creation of the virtualenv & pyenvinstal targets
 2020-12-27 08:27:52 +01:00
Alexandre Flament 2fc2d17a27 Merge pull request #2418 from return42/fix-pyenv-install 
[fix] makefile.python: remove duplicate pyenv-(un)install targets
 2020-12-24 10:23:09 +01:00
Alexandre Flament d129186212 Merge pull request #2417 from return42/fix-seetings-template 
[fix] use SEARX_SETTINGS_TEMPLATE from .config environment
 2020-12-24 10:00:29 +01:00
Alexandre Flament c2aaf6f992 Merge pull request #2415 from return42/upd-useragent 
update useragents
 2020-12-22 16:02:36 +01:00
Alexandre Flament db5b060455 [fix] update buildenv 
CONTACT_URL is unset in Makefile, but searx/brand.py and
utils/brand.env are not updated.

This commit fixes this issue.
 2020-12-21 10:55:28 +01:00
Alexandre Flament 59217bb5be Merge pull request #2397 from dalf/update-ci 
updates for Python 3.9 / update CI
 2020-12-20 09:51:24 +01:00
Alexandre Flament 3f8ebf70b1 [fix] pylint: use "raise ... from ..." 2020-12-20 09:46:53 +01:00
Alexandre Flament eb33ae6893 [fix] Python 3.9: use html.unescape instead of HTMLParser.unescape 2020-12-20 09:46:53 +01:00
Alexandre Flament 6402fb0b9a [enh] CI: use actions/cache@v2 for Python dependencies 2020-12-20 09:42:37 +01:00
Alexandre Flament 04447f8c1a Merge pull request #2398 from dalf/mod-search-query 
Mod search query
 2020-12-20 09:32:54 +01:00
Alexandre Flament 35feb00a5b Merge pull request #2405 from dalf/no-emojis 
[mod] remove emojis from source code
 2020-12-20 09:32:26 +01:00
Alexandre Flament 72d2bb2289 Merge pull request #2399 from return42/fix-lxc 
[fix] determine path to makefile.lxc in a LXC
 2020-12-20 09:32:00 +01:00
Alexandre Flament 32e4eab336 Merge pull request #2401 from return42/drop-virtualenv-cmd 
[mod] remove obsolete virtualenv command
 2020-12-20 09:29:53 +01:00
Alexandre Flament f4983e7415 [mod] remove emojis from source code 2020-12-20 08:58:57 +01:00
Alexandre Flament eda8934f15 [mod] searx.search.EngineRef: remove from_bang parameter 
from_bang is True when the user query contains a bang.
In this case the category is also set to 'none'.

from_bang only usage was in searx.webadapter.parse_specific :
if from_bang is True, then the EngineRef category is ignored and force to 'none'.

This commit also removes the searx.webadapter.parse_sepecific function.
 2020-12-18 12:29:48 +01:00
Alexandre Flament 995ba2f406 [mod] searx.search.SearchQuery: remove categories parameter 
The categories parameter is useless in the constructor:
it is always the categories from the EngineRef.

The categories becomes a property.
 2020-12-18 12:29:48 +01:00
Alexandre Flament 14c7cc0e11 [mod] Makefile: make CONTACT_URL optional 2020-12-18 09:54:03 +01:00
Alexandre Flament 5c6a5407a0 [fix] fix of PR #2225 2020-12-17 16:49:48 +01:00
Alexandre Flament 9b27935f71 Merge pull request #2225 from dalf/processors 
Processors
 2020-12-17 11:49:43 +01:00
Alexandre Flament 02fc4147ce [mod] dictzone, translated, currency_convert: use engine_type online_curency and online_dictionnary 2020-12-17 11:39:36 +01:00
Alexandre Flament 7ec8bc3ea7 [mod] split searx.search into different processors 
see searx.search.processors.abstract.EngineProcessor

First the method searx call the get_params method.

If the return value is not None, then the searx call the method search.
 2020-12-17 11:39:36 +01:00
Alexandre Flament c0cc01e936 [mod] searx.search: search_multiple_requests is a method of Search class 2020-12-17 11:39:36 +01:00
Alexandre Flament 3b87efb3db [mod] move seax/search.py to searx/search/__init__.py 2020-12-17 11:39:36 +01:00
Alexandre Flament 13a2b1a44d Merge pull request #2344 from dalf/mod-themes 
[mod] themes: remove legacy, courgette and pix-art themes
 2020-12-17 11:38:15 +01:00
Alexandre Flament 9bc1856e2b [mod] themes: remove legacy, courgette and pix-art themes 2020-12-17 11:33:28 +01:00
Alexandre Flament 88660fde90 Merge pull request #2396 from lucky13820/patch-1 
Fix the StartPage result title is showing the url
 2020-12-17 08:23:34 +01:00
Alexandre Flament 36235dfde2 Merge pull request #2387 from return42/issue-2383 
[themes] add hyperlink to searx instances list in error message
 2020-12-17 08:20:20 +01:00
Alexandre Flament 002d53abf3 Merge pull request #2389 from searx/update-changelog 
prepare release 0.18.0: update CHANGELOG.rst
 2020-12-14 19:12:12 +01:00
Alexandre Flament 39ac81478c prepare release 0.18.0 2020-12-14 19:03:09 +01:00
Alexandre Flament 7865566338 Merge pull request #2384 from return42/improve-doc 
Improve doc of the installation skripts
 2020-12-14 18:22:12 +01:00
Alexandre Flament d110624df0 Merge pull request #2388 from searx/update-authors 
update AUTHORS.rst with new contributors
 2020-12-14 18:18:23 +01:00
Alexandre Flament 17fdfb6759 Merge pull request #2380 from return42/dev-quickstart 
[doc] update developer quickstart guide
 2020-12-14 18:11:53 +01:00
Alexandre Flament b167ad67a0 update AUTHORS.rst with new contributors 2020-12-14 18:01:42 +01:00
Alexandre Flament 292b73a3fc Merge pull request #2385 from joshu9h/patch-1 
[Fix] Startpage
 2020-12-14 17:56:48 +01:00
Alexandre Flament 36600118fb Merge pull request #2372 from dalf/remove-broken-engines 
[remove] remove searchcode_doc and twitter
 2020-12-13 17:11:05 +01:00
Alexandre Flament 3c4a9c1188 Merge pull request #2358 from dalf/fix-command 
[fix] command engine: SearchQuery.query is str not bytes
 2020-12-11 14:53:24 +01:00
Alexandre Flament 9f8ebeca44 Merge pull request #2375 from dalf/raise_for_errors 
[enh] add raise_for_httperror
 2020-12-11 14:52:18 +01:00
Alexandre Flament d703119d3a [enh] add raise_for_httperror 
check HTTP response:
* detect some comme CAPTCHA challenge (no solving). In this case the engine is suspended for long a time.
* otherwise raise HTTPError as before

the check is done in poolrequests.py (was before in search.py).

update qwant, wikipedia, wikidata to use raise_for_httperror instead of raise_for_status
 2020-12-11 14:37:08 +01:00
Alexandre Flament 033f39bff7 Merge pull request #2376 from dalf/fix-mojeek 
Fix mojeek
 2020-12-11 13:14:54 +01:00
Alexandre Flament 6bc6d5e9fd Merge pull request #2371 from dalf/mod-genius 
[mod) genious: return valid results even if contents are empty
 2020-12-11 13:14:03 +01:00
Alexandre Flament 0ba74cd812 [mod] results: don't crash when an engine don't have a category 
According to
https://github.com/searx/searx/blob/820b468bfe96f693d60ce06f1e78af51f00deefc/searx/engines/__init__.py#L87-L88

an engine can have no category at all.

Without this commit, searx raise an exception in searx/results.py

Note: in this case, the engine is not shown in the preferences.
 2020-12-10 10:57:07 +01:00
Alexandre Flament d41cafd5f3 [fix] xpath, mojeek: fix commit 58d72f2692 
before commit 58d72f2, category was not set in xpath.py,
so searx/engines/__init__py was setting the category to ['general']

the commit 58d72f2 set the category to [] which is not replaced by searx/engines/__init__.py
consequence: the mojeek engine is hidden in the preferences.

this commit revert the xpath.py change.

close #2368
 2020-12-10 10:52:06 +01:00
Alexandre Flament 1c9e7cef50 [remove] remove searchcode_doc and twitter 
* twitter: the API has changed. the engine needs to rewritten.
* searchcode_doc: the API about documentation doesn't exist anymore.
 2020-12-09 13:14:31 +01:00
Alexandre Flament fa73f10f11 [mod) genious: return valid results even if contents are empty 2020-12-09 13:01:34 +01:00
Alexandre Flament 42a194898b Merge pull request #2360 from dalf/update-libgen 
[mod] libgen: update the URL to http://libgen.rs/
 2020-12-08 20:33:53 +01:00
Alexandre Flament a77d8c8227 Merge pull request #2359 from dalf/update-duden 
[mod] duden engine
 2020-12-08 20:33:38 +01:00
Alexandre Flament bd4869ecd0 Merge pull request #2366 from dalf/remove-seedpeer 
[remove] seedpeer engine
 2020-12-08 20:33:23 +01:00
Alexandre Flament 35bf568b41 Merge pull request #2362 from return42/use_default_settings 
[doc] recommend to use 'use_default_settings=True'
 2020-12-08 20:33:06 +01:00
Alexandre Flament 56c64d6b64 [remove] seedpeer engine 
the website is offline.
 2020-12-07 21:02:29 +01:00
Alexandre Flament c1a9732268 Merge pull request #2364 from dalf/fix-youtube-noapi 
[fix] youtube_noapi engine
 2020-12-07 20:26:00 +01:00
Alexandre Flament 13d3004703 Merge pull request #2365 from dalf/fix-soundcloud 
[fix] soundclound: accept result without content
 2020-12-07 20:25:17 +01:00
Alexandre Flament 62073c0e1d Merge pull request #2361 from dalf/fix-1x 
[fix] 1x engine
 2020-12-07 20:24:47 +01:00
Alexandre Flament 923bc02c17 Merge pull request #2363 from dalf/fix-wikipedia-minor 
[fix] wikipedia: minor fix: return no result instead of crash in some very few cases.
 2020-12-07 18:33:37 +01:00
Alexandre Flament deb1bde20d [fix] soundclound: accept result without content 2020-12-07 17:45:36 +01:00
Alexandre Flament 34df0f7910 [fix] youtube_noapi engine 2020-12-07 17:44:31 +01:00
Alexandre Flament 58d51e082d [fix] wikipedia: minor fix: return no result instead of crash in some very few cases. 
In few cases, the JSON results doesn't contains the key 'type'.
 2020-12-07 17:42:05 +01:00
Alexandre Flament 4ec810749b [fix] 1x engine 2020-12-07 15:46:00 +01:00
Alexandre Flament 1e781863fa [fix] command engine: SearchQuery.query is str not bytes 
see c225db45c8
 2020-12-07 10:43:42 +01:00
Alexandre Flament 9bf594cbcf [mod] duden engine 
* add params['soft_max_redirects'] = 1  (when there is spelling suggestion)
* avoid try..except
* use eval_xpath_* functions
 2020-12-07 10:31:11 +01:00
Alexandre Flament b3032cf953 [mod] libgen: update the URL to http://libgen.rs/ 
https://libgen.is actually redirect to http://libgen.rs/

It seems there is no HTTPS version:
* https://www.wikidata.org/wiki/Q22017206
* https://librarygenesis.net/
 2020-12-07 10:19:34 +01:00
Alexandre Flament a458451d20 Merge pull request #2356 from dalf/fix-ddd 
[fix] duckduckgo_definitions: fix relative image URL
 2020-12-07 10:16:53 +01:00
Alexandre Flament 925bb561a2 Merge pull request #2352 from dalf/no_http 
Remove HTTP connections as much as possible
 2020-12-06 10:18:49 +01:00
Alexandre Flament 28cc644f0a [fix] duckduckgo_definitions: fix relative image URL 
ddg returns relative URL to https://duckduckgo.com/
 2020-12-06 10:14:09 +01:00
Alexandre Flament cdceec1cbb Merge pull request #2354 from dalf/fix-wikipedia 
[fix] wikipedia engine: don't raise an error when the query is not found
 2020-12-04 20:42:45 +01:00
Alexandre Flament f0054d67f1 [fix] wikipedia engine: don't raise an error when the query is not found 
Add a new parameter "raise_for_status", set by default to True.
When True, any HTTP status code >= 300 raise an exception ( #2332 )
When False, the engine can manage the HTTP status code by itself.
 2020-12-04 20:04:39 +01:00
Alexandre Flament d9494283cc Merge pull request #2353 from dalf/fix-wikidata 
[fix] wikidata: fix crash when the item has no description at all and…
 2020-12-04 18:07:24 +01:00
Alexandre Flament bef2f2efa8 [fix] wikidata: fix crash when the item has no description at all and at least one URL. 2020-12-04 17:17:20 +01:00
Alexandre Flament 38d32337e7 [mod] documentations & comments: update http://* URL to https://*. 
About http://lesscss.org see https://github.com/less/less-docs/issues/520
 2020-12-04 16:52:25 +01:00
Alexandre Flament 244e812f37 [fix] remove searx/engines/filecrop.py (dead code) 2020-12-04 16:48:15 +01:00
Alexandre Flament 0226ae69d3 [fix] dbpedia autocomplete (and use HTTPS) 2020-12-04 16:47:43 +01:00
Alexandre Flament f56e78ee80 Merge pull request #2338 from unixfox/issue-template 
add new issue template
 2020-12-03 19:16:11 +01:00
Alexandre Flament cec73b5dcf Merge pull request #2350 from dalf/mod-engines-report-captcha 
[mod] stackoverflow & yandex: detect CAPTCHA response
 2020-12-03 13:50:12 +01:00
Alexandre Flament fa909c7c02 [mod] stackoverflow & yandex: detect CAPTCHA response 2020-12-03 13:23:19 +01:00
Alexandre Flament 7905d41487 Merge pull request #2349 from dalf/fix-settings-loader 
[fix] settings_loader: don't crash when a key exists only in the user settings
 2020-12-03 11:47:53 +01:00
Alexandre Flament d0d7a3e1c2 [fix] settings_loader: don't crash when a key exists only in the user settings 
typical use case: result_proxy can be defined in the user settings,
but are not defined the default settings.yml
 2020-12-03 11:35:12 +01:00
Alexandre Flament 89fbb85d45 Merge pull request #2332 from dalf/metrology-errors 
[enh] record exception details per engine
 2020-12-03 10:31:44 +01:00
Alexandre Flament 64cccae99e [mod] various engines: use eval_xpath* functions and searx.exceptions.* 
Engine list: ahmia, duckduckgo_images, elasticsearch, google, google_images, google_videos, youtube_api
 2020-12-03 10:22:48 +01:00
Alexandre Flament ad72803ed9 [mod] xpath, 1337x, acgsou, apkmirror, archlinux, arxiv: use eval_xpath_* functions 2020-12-03 10:22:48 +01:00
Alexandre Flament de887c6347 [mod] bing_news: use eval_xpath_getindex 
remove unused function searx.utils.list_get
 2020-12-03 10:22:48 +01:00
Alexandre Flament 1d0c368746 [enh] record details exception per engine 
add an new API /stats/errors
 2020-12-03 10:22:48 +01:00
Alexandre Flament 6b5a578822 Merge pull request #2285 from return42/fix-digg 
bugfix & refactor digg engine
 2020-12-03 10:20:40 +01:00
Alexandre Flament 219af243a2 Merge pull request #2318 from dalf/add-pylint 
Add pylint
 2020-12-01 15:31:10 +01:00
Alexandre Flament 8aa2a7556a [enh] activate pylint 
There are 3 invocations:
* one with the default .pylintrc file
* one for searx/engines with some disabled checks and some additional-builtins
* one for the all the code except the engines with some disabled checks
 2020-12-01 15:21:19 +01:00
Alexandre Flament b00d108673 [mod] pylint: numerous minor code fixes 2020-12-01 15:21:19 +01:00
Alexandre Flament 9ed3ee2beb [mod] wikidata: WDGeoAttribute class: doesn't change the method signature of get_str 2020-12-01 15:21:17 +01:00
Alexandre Flament 3cfef61123 [fix] /stats: report error percentage instead of error count 
This bug exists since the PR https://github.com/searx/searx/pull/751
 2020-12-01 15:07:09 +01:00
Alexandre Flament b7f1a8424a [fix] tests: fix duplicate method name 2020-12-01 15:07:09 +01:00