retoor/searxng
1
0
Fork 0
Code Issues Pull Requests Actions Packages Projects Releases Wiki Activity
6,963 Commits 6 Branches 17 Tags
a5a73d77b368546d8cde24be6e166685fc2f2dfd
Commit Graph
100 Commits
This Branch
This Branch
All Branches
Author SHA1 Message Date
Markus Heiser 233ee1bb15 Merge pull request #2157 from searxng/dependabot/pip/master/selenium-4.8.0 
Bump selenium from 4.7.2 to 4.8.0
 2023-02-04 09:06:55 +01:00
Markus Heiser 01492cf1cc Merge pull request #2160 from searxng/dependabot/pip/master/flask-babel-3.0.1 
Bump flask-babel from 3.0.0 to 3.0.1
 2023-02-04 09:05:44 +01:00
Markus Heiser 4bc69c803d Merge pull request #2156 from searxng/dependabot/pip/master/splinter-0.19.0 
Bump splinter from 0.18.1 to 0.19.0
 2023-02-04 08:21:55 +01:00
Markus Heiser 9faf0dc289 Merge pull request #2161 from return42/fix-2146 
[fix-2146] set different HTTP Referer header to DuckDuckGo requests
 2023-02-03 10:35:52 +01:00
Markus Heiser 257dc7d6c4 [fix-2146] set different HTTP Referer header to DuckDuckGo requests 
For what ever reasons, ddg-lite don't like the Referer

  https://lite.duckduckgo.com/

In an interactive session in the WEB browser the the Reverer has exactly this
value, but ddg-lite don't like this value when the request is build up by
SearXNG.  The new value is:

  https://google.com/

What fakes a user comes from a google link.

Related: https://github.com/searxng/searxng/pull/2081
Closes: https://github.com/searxng/searxng/issues/2146

Signed-off-by: Markus Heiser <markus.heiser@darmarit.de>
 2023-02-03 08:45:51 +01:00
Markus Heiser d9ab83642f Merge pull request #2148 from return42/lxc-ubu2204 
[LXC] ubuntu 21.10 upgrade to ubuntu 22.04 LTS
 2023-02-01 10:06:48 +01:00
Markus Heiser c90e157ddd [LXC] ubuntu 21.10 upgrade to ubuntu 22.04 LTS [1] 
[1] https://wiki.ubuntu.com/Releases

Tested by::

    # build the container ..
    $ sudo -H ./utils/lxc.sh build searxng-ubu2204

    # install a complete SearXNG suite ..
    $ sudo -H ./utils/lxc.sh cmd searxng-ubu2204 FORCE_TIMEOUT=0 ./utils/searxng.sh install all

    # install nginx to export the SearXNG instance by HTTP
    $ sudo -H ./utils/lxc.sh cmd searxng-ubu2204 FORCE_TIMEOUT=0 ./utils/searxng.sh install nginx

    # check instance
    $  sudo -H ./utils/lxc.sh cmd searxng-ubu2204 FORCE_TIMEOUT=0 ./utils/searxng.sh instance check
    INFO:  [searxng-ubu2204] FORCE_TIMEOUT=0 ./utils/searxng.sh instance check
    INFO:  wrapper:  utils/searxng.sh instance _call searxng.check

    SearXNG checks
    --------------
    ...
    INFO    searx                         : merge the default settings ( /usr/local/searxng/searxng-src/searx/settings.yml ) and the user settings ( /etc/searxng/settings.yml )
    INFO    searx                         : max_request_timeout=None
    INFO    searx.redisdb                 : connecting to Redis db=0 path='/usr/local/searxng-redis/run/redis.sock'
    INFO    searx.redisdb                 : connected to Redis

Signed-off-by: Markus Heiser <markus.heiser@darmarit.de>
 2023-02-01 09:30:13 +01:00
Markus Heiser 031162be04 [doc] settings.py document search.suspended_times 
Signed-off-by: Markus Heiser <markus.heiser@darmarit.de>
 2023-01-29 19:26:16 +00:00
Markus Heiser feccee01c0 [doc] Add doc-strings to searx.exceptions 
Signed-off-by: Markus Heiser <markus.heiser@darmarit.de>
 2023-01-29 19:06:19 +01:00
Markus Heiser 4f808088f1 Merge pull request #2139 from dalf/fix_update_languages 
Fix update languages
 2023-01-29 17:59:59 +01:00
Markus Heiser d989c9429f Merge pull request #2134 from searxng/update_data_update_wikidata_units.py 
Update searx.data - update_wikidata_units.py
 2023-01-29 17:59:40 +01:00
Markus Heiser 5c2667b956 Merge pull request #2135 from searxng/update_data_update_ahmia_blacklist.py 
Update searx.data - update_ahmia_blacklist.py
 2023-01-29 17:59:03 +01:00
Markus Heiser e6a17f2fae Merge pull request #2136 from searxng/update_data_update_firefox_version.py 
Update searx.data - update_firefox_version.py
 2023-01-29 17:58:22 +01:00
Markus Heiser c4cbf8829a Merge pull request #2137 from searxng/update_data_update_currencies.py 
Update searx.data - update_currencies.py
 2023-01-29 17:57:56 +01:00
Markus Heiser 2b60124546 Merge pull request #2138 from searxng/update_data_update_engine_descriptions.py 
Update searx.data - update_engine_descriptions.py
 2023-01-29 17:57:25 +01:00
Markus Heiser afd71a6c0f Merge pull request #2089 from ahmad-alkadri/fix/bing-check-nolinks 
Added a check to see if the element contains links
 2023-01-09 15:17:31 +01:00
Markus Heiser a90ed481ed Merge pull request #2090 from Milad-Laly/bugfix/mojeek_parsing 
[fix] Mojeek Xpath showing suggestions and searches + add lang support
 2023-01-09 09:40:44 +01:00
Markus Heiser 54e63839db Merge pull request #2088 from llmII/fix-suggestions 
Fix #2083
 2023-01-08 18:53:32 +01:00
Markus Heiser 9d6b048fba [build] /static 2023-01-08 18:39:37 +01:00
Markus Heiser 217395b837 Merge pull request #2085 from allixx/tab-order 
[simple theme] set tab index for search page input field #1891
 2023-01-08 16:45:17 +01:00
Markus Heiser 4e735b289b Merge pull request #2084 from Milad-Laly/bugfix/typos 
[fix] typos in utils/searxng.sh
 2023-01-08 10:13:07 +01:00
Markus Heiser 0c429d707a Merge pull request #2073 from ahmad-alkadri/fix/modify-bing-xpath 
Modify the Xpath for Bing engine plus little fixes
 2023-01-08 09:27:00 +01:00
Markus Heiser 4e355564d2 Merge pull request #1903 from LalleSX/patch-1 
Added info about adding the enginge to the brownser
 2023-01-07 15:03:12 +01:00
Markus Heiser 4cd3be8964 [fix] indentation and line size of the the markdown files 
Signed-off-by: Markus Heiser <markus.heiser@darmarit.de>
 2023-01-07 14:46:31 +01:00
Markus Heiser cb7b091666 Merge pull request #2072 from llmII/fix-checksum 
Fix checksum virtualenv checks.
 2023-01-07 13:52:17 +01:00
Markus Heiser a98c5156bd Merge pull request #2066 from ahmad-alkadri/fix/ui-shifted-engines 
Fix: wrapping list of engines in flex-wrap to prevent them being shifted
 2023-01-07 12:19:23 +01:00
Markus Heiser b2a80347e3 [build] /static 2023-01-07 11:53:51 +01:00
Markus Heiser 633ba8b1b6 Merge pull request #2081 from rudism/duckduckgo-referer 
Add HTTP Referer header to DuckDuckGo requests
 2023-01-07 08:27:18 +01:00
Markus Heiser b241015e93 Merge pull request #2078 from searxng/dependabot/pip/master/pygments-2.14.0 
Bump pygments from 2.13.0 to 2.14.0
 2023-01-06 08:40:46 +01:00
Markus Heiser 269a72ee97 Merge pull request #2079 from searxng/translations_update 
Update translations
 2023-01-06 08:40:03 +01:00
Markus Heiser e9a7a6aea6 [build] /static 2023-01-06 08:35:52 +01:00
Markus Heiser aba969ccf0 Merge pull request #2074 from julianfairfax/patch-1 
Correct a small mistake
 2023-01-05 07:19:55 +01:00
Markus Heiser 647a0aa98b Merge pull request #2060 from searxng/dependabot/pip/master/mock-5.0.0 
Bump mock from 4.0.3 to 5.0.0
 2022-12-30 17:03:53 +01:00
Markus Heiser 1751629098 Merge pull request #2061 from searxng/translations_update 
Update translations
 2022-12-30 08:22:42 +01:00
Markus Heiser b6d98be795 Merge pull request #2059 from searxng/dependabot/pip/master/pallets-sphinx-themes-2.0.3 
Bump pallets-sphinx-themes from 2.0.2 to 2.0.3
 2022-12-30 08:21:37 +01:00
Markus Heiser 9b31976cf3 Merge pull request #2056 from searxng/update_data_update_firefox_version.py 
Update searx.data - update_firefox_version.py
 2022-12-29 09:24:09 +01:00
Markus Heiser 174e6851b3 Merge pull request #2054 from searxng/update_data_update_currencies.py 
Update searx.data - update_currencies.py
 2022-12-29 08:35:51 +01:00
Markus Heiser d531f89316 Merge pull request #2057 from searxng/update_data_update_engine_descriptions.py 
Update searx.data - update_engine_descriptions.py
 2022-12-29 08:31:19 +01:00
Markus Heiser 76cd808a49 Merge pull request #2053 from searxng/update_data_update_ahmia_blacklist.py 
Update searx.data - update_ahmia_blacklist.py
 2022-12-29 08:28:19 +01:00
Markus Heiser 3ec58b0649 Merge pull request #2055 from searxng/update_data_update_wikidata_units.py 
Update searx.data - update_wikidata_units.py
 2022-12-29 08:28:10 +01:00
Markus Heiser e8f72d7052 Merge pull request #2040 from searxng/translations_update 
Update translations
 2022-12-23 08:24:49 +01:00
Markus Heiser a2d506d45b Merge pull request #2039 from searxng/dependabot/pip/master/pylint-2.15.9 
Bump pylint from 2.15.8 to 2.15.9
 2022-12-23 08:23:05 +01:00
Markus Heiser d75ae7c8e6 Merge pull request #2035 from rudism/fix-ddg-url 
Fix: add trailing slash to duckduckgo url
 2022-12-22 15:02:01 +01:00
Markus Heiser 0dac581c0d Merge pull request #2024 from searxng/dependabot/pip/master/black-22.12.0 
Bump black from 22.10.0 to 22.12.0
 2022-12-16 09:04:57 +01:00
Markus Heiser 42ca37a6b8 Merge pull request #2023 from searxng/dependabot/pip/master/lxml-4.9.2 
Bump lxml from 4.9.1 to 4.9.2
 2022-12-16 09:03:24 +01:00
Markus Heiser f5bd73d9da Merge pull request #2025 from searxng/translations_update 
Update translations
 2022-12-16 08:27:04 +01:00
Markus Heiser 966e9c3c5d Merge pull request #1969 from ArtikusHG/master 
Add language autodetect plugin
 2022-12-12 08:13:17 +01:00
Markus Heiser ed901ab18e [mod] improve 'Autodetect search language' plugin 
- Add documentation to the plugin
- Harmonize FastText language model with SearXNG's language model

Reosurces::

    import fasttext                                    # --> +10 MB
    fasttext.load_model(str(data_dir / 'lid.176.ftz')) # --> +4MB

Suggested-by: @dalf

- To speed up and simplify the deployment use fasttext-wheel instead of fasttext
- Building numpy on the Alpine Linux of docker-images takes ages --> install
  py3-numpy from Alpines package manager (apk)
- Alpine Linux on docker-images (musl libc) do not support fasttext-wheel (gnu
  libc) --> patch Dockerfile and build from fastetxt:

     sed -i s/fasttext-wheel/fasttext/ requirements.txt

Signed-off-by: Markus Heiser <markus.heiser@darmarit.de>
 2022-12-11 11:26:07 +01:00
Markus Heiser ffb72dfdf7 Merge pull request #1996 from searxng/dependabot/pip/master/selenium-4.7.0 
Bump selenium from 4.6.0 to 4.7.0
 2022-12-02 09:07:45 +01:00
Markus Heiser 317fe0a256 Merge pull request #1999 from searxng/dependabot/pip/master/twine-4.0.2 
Bump twine from 4.0.1 to 4.0.2
 2022-12-02 09:02:07 +01:00
Markus Heiser e67a7b808b Merge pull request #1998 from searxng/dependabot/pip/master/linuxdoc-20221127 
Bump linuxdoc from 20221025 to 20221127
 2022-12-02 09:01:47 +01:00
Markus Heiser 890d63b986 Merge pull request #1997 from searxng/dependabot/pip/master/pylint-2.15.7 
Bump pylint from 2.15.6 to 2.15.7
 2022-12-02 08:30:07 +01:00
Markus Heiser 4970db05fd Merge pull request #2000 from searxng/translations_update 
Update translations
 2022-12-02 08:29:38 +01:00
Markus Heiser 0361f8366a Merge pull request #1989 from ngosang/feature/idea 
Add PyCharm configuration files to .gitignore
 2022-11-30 13:28:57 +01:00
Markus Heiser 44d4a1714c Merge pull request #1990 from ngosang/feature/alpine 
Update base Docker image to Alpine 3.17
 2022-11-30 10:32:34 +01:00
Markus Heiser f19837cfad Merge pull request #1896 from ngosang/feature/size 
Reduce Docker image size
 2022-11-30 09:16:14 +01:00
Markus Heiser a8359dd4d3 Merge pull request #1981 from searxng/update_data_update_firefox_version.py 
Update searx.data - update_firefox_version.py
 2022-11-29 07:48:26 +01:00
Markus Heiser 1b2f1c17f6 Merge pull request #1982 from searxng/update_data_update_wikidata_units.py 
Update searx.data - update_wikidata_units.py
 2022-11-29 07:47:52 +01:00
Markus Heiser 3579a38a2d Merge pull request #1983 from searxng/update_data_update_currencies.py 
Update searx.data - update_currencies.py
 2022-11-29 07:46:49 +01:00
Markus Heiser 82af2f4460 Merge pull request #1984 from searxng/update_data_update_ahmia_blacklist.py 
Update searx.data - update_ahmia_blacklist.py
 2022-11-29 07:45:51 +01:00
Markus Heiser 5b19f89286 Merge pull request #1985 from searxng/update_data_update_engine_descriptions.py 
Update searx.data - update_engine_descriptions.py
 2022-11-29 07:45:17 +01:00
Markus Heiser 1314c1c534 Merge pull request #1975 from searxng/dependabot/pip/master/pylint-2.15.6 
Bump pylint from 2.15.5 to 2.15.6
 2022-11-25 08:25:46 +01:00
Markus Heiser 28ae469f81 Merge pull request #1976 from searxng/dependabot/pip/master/redis-4.3.5 
Bump redis from 4.3.4 to 4.3.5
 2022-11-25 08:25:24 +01:00
Markus Heiser 5ca6868c98 Merge pull request #1977 from searxng/translations_update 
Update translations
 2022-11-25 08:24:28 +01:00
Markus Heiser 3a765113ee Merge pull request #1950 from searxng/google-fix-pc 
Switch back to protobuf for raw HTML
 2022-11-11 10:46:19 +01:00
Markus Heiser e63457584b Merge pull request #1944 from ngosang/feature/google 
Fix Google search engine.
 2022-11-11 07:42:07 +01:00
Markus Heiser 117f69fa13 Merge pull request #1937 from BoxingOctopus/fix/disable_zlib 
Disabling zlibrary due to z-lib.org domain seizure
 2022-11-10 21:29:45 +01:00
Markus Heiser ee4475ff4b Merge pull request #1934 from dalf/fix_user_agent 
User agent: don't include the patch number in the Firefox version
 2022-11-09 06:50:33 +01:00
Markus Heiser fc9986de0a Merge pull request #1905 from searxng/update_data_update_ahmia_blacklist.py 
Update searx.data - update_ahmia_blacklist.py
 2022-10-29 08:22:43 +02:00
Markus Heiser 3f1d594c23 Merge pull request #1906 from searxng/update_data_update_external_bangs.py 
Update searx.data - update_external_bangs.py
 2022-10-29 08:21:33 +02:00
Markus Heiser a9deead102 Merge pull request #1907 from searxng/update_data_update_firefox_version.py 
Update searx.data - update_firefox_version.py
 2022-10-29 08:20:53 +02:00
Markus Heiser d49ccb54ea Merge pull request #1908 from searxng/update_data_update_wikidata_units.py 
Update searx.data - update_wikidata_units.py
 2022-10-29 08:20:27 +02:00
Markus Heiser fa59ff9b78 Merge pull request #1909 from searxng/update_data_update_currencies.py 
Update searx.data - update_currencies.py
 2022-10-29 08:19:56 +02:00
Markus Heiser d653534fe1 Merge pull request #1910 from searxng/update_data_update_engine_descriptions.py 
Update searx.data - update_engine_descriptions.py
 2022-10-29 08:14:49 +02:00
Markus Heiser 5a181ea1f5 Merge pull request #1901 from searxng/dependabot/npm_and_yarn/searx/static/themes/simple/master/svgo-3.0.0 
Bump svgo from 2.8.0 to 3.0.0 in /searx/static/themes/simple
 2022-10-28 10:22:56 +02:00
Markus Heiser d913f0d8aa [build] /static 2022-10-28 10:17:56 +02:00
Markus Heiser 5db4ed5d2b Merge pull request #1902 from searxng/translations_update 
Update translations
 2022-10-28 09:24:08 +02:00
Markus Heiser c26fa335ac Merge pull request #1900 from searxng/dependabot/pip/master/pylint-2.15.5 
Bump pylint from 2.15.4 to 2.15.5
 2022-10-28 09:19:33 +02:00
Markus Heiser affd8f751d Merge pull request #1872 from searxng/dependabot/pip/master/sphinx-5.3.0 
Bump sphinx from 5.2.3 to 5.3.0
 2022-10-25 13:09:54 +02:00
Markus Heiser 4783d6c9f4 Merge pull request #1886 from return42/linuxdoc-20221025 
[upd] linuxdoc from v20211220 to v20221025
 2022-10-25 12:59:30 +02:00
Markus Heiser 3cc0222801 [upd] linuxdoc from v20211220 to v20221025 
linuxdoc v20221025 fixes an issue with the flat-table directive and adds
:align: & :width: options to flat-table directive.

[1] https://github.com/return42/linuxdoc/pull/18

Signed-off-by: Markus Heiser <markus.heiser@darmarit.de>
 2022-10-25 12:51:46 +02:00
Markus Heiser a733761288 Merge pull request #1853 from return42/sort_osm_keys 
[fix] update_osm_keys_tags.py: sort JSON dump
 2022-10-11 11:57:17 +02:00
Markus Heiser 23d797ee6f Update searx.data - update_osm_keys_tags.py 
Patch was generated by::

  ./manage pyenv.cmd searxng_extra/update/update_osm_keys_tags.py

Signed-off-by: Markus Heiser <markus.heiser@darmarit.de>
 2022-10-11 11:49:06 +02:00
Markus Heiser 9933155a2e [fix] update_osm_keys_tags.py: sort JSON dump 
To get meaningful diff, the keys in JSON dump needs to be sorted.

Signed-off-by: Markus Heiser <markus.heiser@darmarit.de>
 2022-10-11 11:45:26 +02:00
Markus Heiser ba8959ad7c [fix] typos / reported by @kianmeng in searx PR-3366 
[PR-3366] https://github.com/searx/searx/pull/3366

Signed-off-by: Markus Heiser <markus.heiser@darmarit.de>
 2022-09-27 18:32:14 +02:00
Markus Heiser 52023e3d6e [fix] doc of the paper.html template (isbn, issn) 
Signed-off-by: Markus Heiser <markus.heiser@darmarit.de>
 2022-09-25 15:46:29 +02:00
Markus Heiser 0052887929 [fix] springer: unsupported operand type(s) for +: 'NoneType' and 'str' 
- fix issue reported #1809
- filter out `None` value from issn and isbn list
- add comments (from publicationName)
- add publisher

Closes: https://github.com/searxng/searxng/issues/1809
Signed-off-by: Markus Heiser <markus.heiser@darmarit.de>
 2022-09-25 15:25:55 +02:00
Markus Heiser e36b023508 [mod] core.ac.uk: add cetgory 'scientific publications' 
Signed-off-by: Markus Heiser <markus.heiser@darmarit.de>
 2022-09-24 16:16:22 +02:00
Markus Heiser b424ee255e [mod] paper.html: simplify template by using result_link macro 
Signed-off-by: Markus Heiser <markus.heiser@darmarit.de>
 2022-09-24 16:13:36 +02:00
Markus Heiser 3198c906af [mod] paper.html: add links to doi resolver 
Signed-off-by: Markus Heiser <markus.heiser@darmarit.de>
 2022-09-24 14:19:51 +02:00
Markus Heiser c76830d8a8 [mod] core.ac.uk: use paper.html template 
Signed-off-by: Markus Heiser <markus.heiser@darmarit.de>
 2022-09-24 13:19:33 +02:00
Markus Heiser 3ff2ad939d [fix] ERROR searx.engines.core.ac.uk: list index out of range 
Some result items from core.ac.uk do not have an URL::

  Traceback (most recent call last):
  File "searx/search/processors/online.py", line 154, in search
    search_results = self._search_basic(query, params)
  File "searx/search/processors/online.py", line 142, in _search_basic
    return self.engine.response(response)
  File "SearXNG/searx/engines/core.py", line 73, in response
    'url': source['urls'][0].replace('http://', 'https://', 1),

Signed-off-by: Markus Heiser <markus.heiser@darmarit.de>
 2022-09-24 13:19:33 +02:00
Markus Heiser f08165f524 [docs] add description of the field 'type' from paper.html template 
Signed-off-by: Markus Heiser <markus.heiser@darmarit.de>
 2022-09-24 10:56:07 +02:00
Markus Heiser bafebe91ac Merge pull request #1802 from return42/disable-crossref 
[fix] typo in crossref settings: disable --> disabled
 2022-09-24 08:23:49 +02:00
Markus Heiser caebafdd06 [fix] typo in crossref settings: disable --> disabled 
Signed-off-by: Markus Heiser <markus.heiser@darmarit.de>
 2022-09-24 08:12:36 +02:00
Markus Heiser 08b8859705 [doc] paper.html result template 
Signed-off-by: Markus Heiser <markus.heiser@darmarit.de>
 2022-09-23 20:45:58 +02:00
Markus Heiser 627dfc2af6 Merge pull request #1798 from searxng/translations_update 
Update translations
 2022-09-23 13:11:46 +02:00
Markus Heiser 37217d9c3d Merge pull request #1797 from searxng/dependabot/pip/master/pylint-2.15.3 
Bump pylint from 2.15.0 to 2.15.3
 2022-09-23 09:19:35 +02:00
Markus Heiser cf7ee67f71 [mod] google-images: slightly improvements of the engine 
Signed-off-by: Markus Heiser <markus.heiser@darmarit.de>
 2022-09-21 18:59:55 +02:00
Markus Heiser 2faad99718 Merge pull request #1795 from return42/fix-wording 
[fix] wording: SearXNG is 'open' and not 'hackable'
 2022-09-21 17:53:57 +02:00