6,712 Commits 6 Branches 17 Tags 102 MiB
e2dd5a80bb
Commit Graph

231 Commits

Author SHA1 Message Date
dalf
012d7fcaa0 Update searx.data - update_languages.py 2022-06-01 06:31:54 +00:00
dalf
ab9616c2cc Update searx.data - update_wikidata_units.py 2022-06-01 06:31:52 +00:00
Markus Heiser
8a79eb4d7b
Merge pull request #1158 from searxng/update_data_update_currencies.py 
Update searx.data - update_currencies.py
 2022-05-01 09:51:56 +02:00
Markus Heiser
6bd6e09e14
Merge pull request #1159 from searxng/update_data_update_engine_descriptions.py 
Update searx.data - update_engine_descriptions.py
 2022-05-01 09:51:21 +02:00
Markus Heiser
9c7e9bf1d9
Merge pull request #1157 from searxng/update_data_update_wikidata_units.py 
Update searx.data - update_wikidata_units.py
 2022-05-01 09:50:28 +02:00
Markus Heiser
9e6000407a
Merge pull request #1156 from searxng/update_data_update_ahmia_blacklist.py 
Update searx.data - update_ahmia_blacklist.py
 2022-05-01 09:49:55 +02:00
dalf
6f0a717dce Update searx.data - update_engine_descriptions.py 2022-05-01 06:33:42 +00:00
dalf
bdfbc0ec02 Update searx.data - update_currencies.py 2022-05-01 06:26:53 +00:00
dalf
6cb08a568a Update searx.data - update_wikidata_units.py 2022-05-01 06:26:44 +00:00
dalf
10023344a5 Update searx.data - update_ahmia_blacklist.py 2022-05-01 06:26:33 +00:00
dalf
e36d7067a9 Update searx.data - update_firefox_version.py 2022-05-01 06:26:31 +00:00
Markus Heiser
62982c8812 [fix] add back missing languages & regions (followup of PR #1071) 
In PR #1071 the language catalog of dailymotion has been cleaned up, before
there had been over 7000 "languages" in the catalog.

As a side effect of this clean-up the language & region catalog in SearXNG has
been reduced [1].

This patch reduce the ``min_engines_per_lang`` from 13 to 12 to get the missed
languages back in language & region catalog of SearXNG.

[1] 3bb62823ec (diff-f3f00db0f87f95b882624a192e0aac21525638af0b18c9514e765fcf1991678d)

Requested-by: @tiekoetter in a Matrix chat
Signed-off-by: Markus Heiser <markus.heiser@darmarit.de>
 2022-04-22 12:09:42 +02:00
Alexandre Flament
7bf9e12db9 Update searx.data - update_engine_descriptions.py 2022-04-16 13:17:39 +02:00
Markus Heiser
3bb62823ec [fix] dailymotion engine: filter by language & country 
- fix the issue of fetching more the 7000 *languages*
- improve the request function and filter by language & country
- implement time_range_support & safesearch
- add more fields to the response from dailymotion (allow_embed, length)
- better clean up of HTML tags in the 'content' field.

This is more or less a complete rework based on the '/videos' API from [1].
This patch cleans up the language list in SearXNG that has been polluted by the
ISO-639-3 2 and 3 letter codes from dailymotion languages which have never been
used.

[1] https://developers.dailymotion.com/tools/

Closes: https://github.com/searxng/searxng/issues/1065
Signed-off-by: Markus Heiser <markus.heiser@darmarit.de>
 2022-04-16 09:27:34 +02:00
Alexandre Flament
765504ceca
Merge pull request #1031 from dalf/fix-bing-_fetch_supported_languages 
Fix bing  fetch supported languages
 2022-04-02 08:23:58 +02:00
Markus Heiser
099840f4d6
Merge pull request #1035 from searxng/update_data_update_wikidata_units.py 
Update searx.data - update_wikidata_units.py
 2022-04-01 09:02:19 +02:00
Markus Heiser
b853ab717e
Merge pull request #1034 from searxng/update_data_update_ahmia_blacklist.py 
Update searx.data - update_ahmia_blacklist.py
 2022-04-01 09:01:48 +02:00
Markus Heiser
c2de356497
Merge pull request #1033 from searxng/update_data_update_currencies.py 
Update searx.data - update_currencies.py
 2022-04-01 09:00:51 +02:00
dalf
086517d269 Update searx.data - update_wikidata_units.py 2022-04-01 06:27:23 +00:00
dalf
d245ca97ca Update searx.data - update_ahmia_blacklist.py 2022-04-01 06:27:22 +00:00
dalf
084d9ab4e4 Update searx.data - update_currencies.py 2022-04-01 06:27:18 +00:00
dalf
4d55523247 Update searx.data - update_firefox_version.py 2022-04-01 06:27:13 +00:00
Alexandre FLAMENT
7d31b2c0af Update languages 2022-03-31 20:04:46 +00:00
Markus Heiser
0ddcc12474
Merge pull request #934 from searxng/update_data_update_ahmia_blacklist.py 
Update searx.data - update_ahmia_blacklist.py
 2022-03-01 07:54:58 +01:00
Markus Heiser
69f84d941f
Merge pull request #935 from searxng/update_data_update_firefox_version.py 
Update searx.data - update_firefox_version.py
 2022-03-01 07:53:33 +01:00
Markus Heiser
5508155252
Merge pull request #936 from searxng/update_data_update_wikidata_units.py 
Update searx.data - update_wikidata_units.py
 2022-03-01 07:52:54 +01:00
dalf
f4c6eba227 Update searx.data - update_currencies.py 2022-03-01 06:25:18 +00:00
dalf
6946c4566f Update searx.data - update_wikidata_units.py 2022-03-01 06:24:57 +00:00
dalf
49bc3971ae Update searx.data - update_firefox_version.py 2022-03-01 06:24:55 +00:00
dalf
6add9dd6d3 Update searx.data - update_ahmia_blacklist.py 2022-03-01 06:24:53 +00:00
Markus Heiser
314ea2dc61
Merge pull request #852 from searxng/update_data_update_ahmia_blacklist.py 
Update searx.data - update_ahmia_blacklist.py
 2022-02-01 06:52:57 +00:00
Markus Heiser
4d0bd47ff0
Merge pull request #853 from searxng/update_data_update_firefox_version.py 
Update searx.data - update_firefox_version.py
 2022-02-01 06:52:19 +00:00
Markus Heiser
20cbabff96
Merge pull request #851 from searxng/update_data_update_currencies.py 
Update searx.data - update_currencies.py
 2022-02-01 06:48:54 +00:00
dalf
f4f90aa3a4 Update searx.data - update_firefox_version.py 2022-02-01 06:23:16 +00:00
dalf
7b402e1aa0 Update searx.data - update_ahmia_blacklist.py 2022-02-01 06:23:01 +00:00
dalf
1c47f4b6e0 Update searx.data - update_currencies.py 2022-02-01 06:23:00 +00:00
dalf
e78dc45d1e Update searx.data - update_wikidata_units.py 2022-02-01 06:22:58 +00:00
Alexandre Flament
f3f61df6a0 [mod] remove deprecate code 
remove code to support Python 3.5 and Python 3.6
 2022-01-29 08:54:12 +01:00
Markus Heiser
a7c3c352d8 [upd] searx/data/external_bangs.json 
Updated external bangs by::

    ./manage pyenv.cmd ./searxng_extra/update/update_external_bangs.py

Signed-off-by: Markus Heiser <markus.heiser@darmarit.de>
 2022-01-12 19:37:13 +01:00
Markus Heiser
1461d6a07e [upd] engine_descriptions.json 
Updated by:

    ./manage pyenv.cmd python3 \
        ./searxng_extra/update/update_engine_descriptions.py

Signed-off-by: Markus Heiser <markus.heiser@darmarit.de>
 2022-01-07 13:59:03 +01:00
Markus Heiser
3cdf2d6570 Update searx.data - update_languages.py 
Signed-off-by: Markus Heiser <markus.heiser@darmarit.de>
 2022-01-01 18:37:35 +01:00
Alexandre Flament
6b49f32d3e
Merge pull request #670 from searxng/update_data_update_firefox_version.py 
Update searx.data - update_firefox_version.py
 2022-01-01 12:16:50 +01:00
Markus Heiser
3dcba2f67c
Merge pull request #671 from searxng/update_data_update_ahmia_blacklist.py 
Update searx.data - update_ahmia_blacklist.py
 2022-01-01 12:08:26 +01:00
Markus Heiser
877293c470
Merge pull request #673 from searxng/update_data_update_currencies.py 
Update searx.data - update_currencies.py
 2022-01-01 12:08:02 +01:00
dalf
127da09fc9 Update searx.data - update_wikidata_units.py 2022-01-01 06:25:06 +00:00
dalf
291483af53 Update searx.data - update_currencies.py 2022-01-01 06:25:02 +00:00
dalf
a0016250ec Update searx.data - update_ahmia_blacklist.py 2022-01-01 06:24:59 +00:00
dalf
184242d36b Update searx.data - update_firefox_version.py 2022-01-01 06:24:49 +00:00
Markus Heiser
3d96a9839a [format.python] initial formatting of the python code 
This patch was generated by black [1]::

    make format.python

[1] https://github.com/psf/black

Signed-off-by: Markus Heiser <markus.heiser@darmarit.de>
 2021-12-27 09:26:22 +01:00
Markus Heiser
c5d604f06f [upd] engine_descriptions.json 
Updated by:

    ./manage pyenv.cmd python3 \
        ./searxng_extra/update/update_engine_descriptions.py

Include documentation of new added engines:

- superuser
- stackoverflow
- askubuntu
- indb
- ...

Signed-off-by: Markus Heiser <markus.heiser@darmarit.de>
 2021-12-20 14:39:10 +01:00
Markus Heiser
e62733fcf3
Merge pull request #571 from searxng/update_data_update_languages.py 
Update searx.data - update_languages.py
 2021-12-01 07:30:41 +01:00
Markus Heiser
24d04f2854
Merge pull request #570 from searxng/update_data_update_firefox_version.py 
Update searx.data - update_firefox_version.py
 2021-12-01 07:29:56 +01:00
Markus Heiser
a3fc1304cc
Merge pull request #569 from searxng/update_data_update_currencies.py 
Update searx.data - update_currencies.py
 2021-12-01 07:29:24 +01:00
dalf
c74b465ece Update searx.data - update_languages.py 2021-12-01 06:24:47 +00:00
dalf
56e653011f Update searx.data - update_firefox_version.py 2021-12-01 06:24:38 +00:00
dalf
b833e08fc3 Update searx.data - update_currencies.py 2021-12-01 06:24:29 +00:00
dalf
5fdf8f04b7 Update searx.data - update_ahmia_blacklist.py 2021-12-01 06:24:25 +00:00
Markus Heiser
07f849cd56
Merge pull request #468 from searxng/update_data_update_ahmia_blacklist.py 
Update searx.data - update_ahmia_blacklist.py
 2021-11-01 06:49:09 +00:00
Markus Heiser
853a144bb4
Merge pull request #467 from searxng/update_data_update_firefox_version.py 
Update searx.data - update_firefox_version.py
 2021-11-01 06:48:43 +00:00
Markus Heiser
82a0dfab61
Merge pull request #466 from searxng/update_data_update_wikidata_units.py 
Update searx.data - update_wikidata_units.py
 2021-11-01 06:48:15 +00:00
dalf
f3dfdad1d1 Update searx.data - update_ahmia_blacklist.py 2021-11-01 06:24:06 +00:00
dalf
2be4c35f76 Update searx.data - update_firefox_version.py 2021-11-01 06:23:59 +00:00
dalf
073d3edc0c Update searx.data - update_wikidata_units.py 2021-11-01 06:23:58 +00:00
dalf
3d9be86519 Update searx.data - update_currencies.py 2021-11-01 06:23:54 +00:00
Markus Heiser
f63ffbb22b [fix] engine - yahoo: rewrite and fix issues 
Languages are supported by mapping the language to a domain.  If domain is not
found in :py:obj:`lang2domain` URL ``<lang>.search.yahoo.com`` is used.

BTW: fix issue reported at https://github.com/searx/searx/issues/3020

Signed-off-by: Markus Heiser <markus.heiser@darmarit.de>
 2021-10-16 20:05:26 +00:00
Alexandre Flament
1bb82a6b54 SearXNG: searxng_extra 2021-10-02 17:30:39 +02:00
Markus Heiser
fda5609a17
Merge pull request #360 from return42/ddg-lite 
Implement a DuckDuckGo Lite engine
 2021-10-02 05:16:29 +00:00
Markus Heiser
97419a770d [upd] make data.languages 
Signed-off-by: Markus Heiser <markus.heiser@darmarit.de>
 2021-10-01 20:01:41 +02:00
Markus Heiser
c74f45b1df
Merge pull request #365 from searxng/update_data_update_wikidata_units.py 
Update searx.data - update_wikidata_units.py
 2021-10-01 07:11:13 +00:00
Markus Heiser
62ea3c7074
Merge pull request #366 from searxng/update_data_update_languages.py 
Update searx.data - update_languages.py
 2021-10-01 06:41:09 +00:00
Markus Heiser
d814f1182f
Merge pull request #364 from searxng/update_data_update_firefox_version.py 
Update searx.data - update_firefox_version.py
 2021-10-01 06:34:20 +00:00
Markus Heiser
8479a83411
Merge pull request #363 from searxng/update_data_update_ahmia_blacklist.py 
Update searx.data - update_ahmia_blacklist.py
 2021-10-01 06:33:51 +00:00
dalf
db51a64390 Update searx.data - update_languages.py 2021-10-01 06:23:31 +00:00
dalf
a582e55af0 Update searx.data - update_wikidata_units.py 2021-10-01 06:23:25 +00:00
dalf
56c68beb42 Update searx.data - update_firefox_version.py 2021-10-01 06:23:14 +00:00
dalf
453114fbe4 Update searx.data - update_ahmia_blacklist.py 2021-10-01 06:23:12 +00:00
dalf
0c24a03f05 Update searx.data - update_currencies.py 2021-10-01 06:23:04 +00:00
Alexandre Flament
bfd24d1226 [mod] add /engine_descriptions.json endpoint 
returns engine descriptions (JSON):
* key: engine name
* value: description in the user locale, use English description as a fallback
 2021-09-24 20:20:30 +02:00
Markus Heiser
065b4dab56
Merge pull request #278 from searxng/update_data_update_ahmia_blacklist.py 
Update searx.data - update_ahmia_blacklist.py
 2021-09-01 06:48:55 +00:00
Markus Heiser
a7a879181d
Merge pull request #279 from searxng/update_data_update_currencies.py 
Update searx.data - update_currencies.py
 2021-09-01 06:46:29 +00:00
Markus Heiser
00a51fa17f
Merge pull request #280 from searxng/update_data_update_firefox_version.py 
Update searx.data - update_firefox_version.py
 2021-09-01 06:44:22 +00:00
dalf
9e3113865d Update searx.data - update_firefox_version.py 2021-09-01 06:23:44 +00:00
dalf
a45fc66e83 Update searx.data - update_currencies.py 2021-09-01 06:23:35 +00:00
dalf
44f7e1fcaa Update searx.data - update_ahmia_blacklist.py 2021-09-01 06:23:20 +00:00
dalf
a556d0c1aa Update searx.data - update_wikidata_units.py 2021-09-01 06:23:11 +00:00
Markus Heiser
e0ca749ff5
Merge pull request #242 from searxng/update_data_update_currencies.py 
Update searx.data - update_currencies.py
 2021-08-02 07:40:19 +00:00
Alexandre Flament
b6711ba0ad
Merge pull request #241 from searxng/update_data_update_languages.py 
Update searx.data - update_languages.py
 2021-08-02 09:01:57 +02:00
Markus Heiser
0fc1dcbfa5
Merge pull request #243 from searxng/update_data_update_wikidata_units.py 
Update searx.data - update_wikidata_units.py
 2021-08-01 09:42:01 +00:00
dalf
7fae5647d3 Update searx.data - update_wikidata_units.py 2021-08-01 06:24:23 +00:00
dalf
2963c83daa Update searx.data - update_currencies.py 2021-08-01 06:24:13 +00:00
dalf
4d3f2f48d2 Update searx.data - update_languages.py 2021-08-01 06:24:12 +00:00
dalf
f5389fd722 Update searx.data - update_firefox_version.py 2021-08-01 06:24:01 +00:00
Markus Heiser
ef6e1bd6b9 [fix] Qwant engines - implement API v3 and add 'quant videos' 
The implementation uses the Qwant API (https://api.qwant.com/v3). The API is
undocumented but can be reverse engineered by reading the network log of
https://www.qwant.com/ queries.

This implementation is used by different qwant engines in the settings.yml::

  - name: qwant
    categories: general
    ...
  - name: qwant news
    categories: news
    ...
  - name: qwant images
    categories: images
    ...
  - name: qwant videos
    categories: videos
    ...

Signed-off-by: Markus Heiser <markus.heiser@darmarit.de>
 2021-07-14 09:47:32 +02:00
Alexandre Flament
961dd287a1
Merge pull request #185 from searxng/update_data_update_external_bangs.py 
Update searx.data - update_external_bangs.py
 2021-07-01 18:43:18 +02:00
Alexandre Flament
508195a850
Merge pull request #186 from searxng/update_data_update_wikidata_units.py 
Update searx.data - update_wikidata_units.py
 2021-07-01 18:41:54 +02:00
Alexandre Flament
89a27f4f96
Merge pull request #187 from searxng/update_data_update_ahmia_blacklist.py 
Update searx.data - update_ahmia_blacklist.py
 2021-07-01 18:41:43 +02:00
dalf
973d507410 Update searx.data - update_ahmia_blacklist.py 2021-07-01 06:22:48 +00:00
dalf
f6a8a5d017 Update searx.data - update_firefox_version.py 2021-07-01 06:22:48 +00:00
dalf
77a432cc95 Update searx.data - update_wikidata_units.py 2021-07-01 06:22:43 +00:00
dalf
726ad776a3 Update searx.data - update_external_bangs.py 2021-07-01 06:22:24 +00:00