retoor/searxng
1
0
Fork 0
Code Issues Pull Requests Actions Packages Projects Releases Wiki Activity
8,351 Commits 6 Branches 17 Tags
a7e1e5d93e256672da0a5f3ebb4e93bc4eb3f475
Commit Graph
100 Commits
This Branch
This Branch
All Branches
Author SHA1 Message Date
Markus Heiser 06f6ee4e36 [build] /static 2025-01-26 13:34:52 +01:00
Markus Heiser 9beff8212b [refactor] results.js: wait one second before loading full high-res image 
Signed-off-by: Markus Heiser <markus.heiser@darmarit.de>
 2025-01-26 13:34:52 +01:00
Markus Heiser bee2677929 [build] /static 2025-01-21 22:55:45 +01:00
Markus Heiser e7081bb2c1 [update] make pygments.less 
Signed-off-by: Markus Heiser <markus.heiser@darmarit.de>
 2025-01-21 16:12:27 +01:00
Markus Heiser 98c66c0ae6 [build] /static 2025-01-20 16:41:00 +01:00
Markus Heiser c06ec65b2a [fix] LESS sourcemaps broken in less-plugin-clean-css v1.6.0 
The ``less-plugin-clean-css`` lacks some maintenance: the sourcemaps are broken
since v1.6.0 (08/2024) [1]

- [1] https://github.com/less/less-plugin-clean-css/issues/42

Closes: https://github.com/searxng/searxng/issues/4143

Signed-off-by: Markus Heiser <markus.heiser@darmarit.de>
 2025-01-20 16:41:00 +01:00
Markus Heiser e581921c92 [fix] engine brave: remove date from the content string 
Related: https://github.com/searxng/searxng/issues/4211#issuecomment-2601941440
Closes: https://github.com/searxng/searxng/issues/4006

Signed-off-by: Markus Heiser <markus.heiser@darmarit.de>
 2025-01-20 16:40:36 +01:00
Markus Heiser 073d9549a0 [build] /static 2025-01-20 13:52:43 +01:00
Markus Heiser 601ffcb8a3 [mod] add swipe events to the image gallery (gesture control) 
Adds [1] to the searxng.min.js and horizontal swipe events to the image gallery.

[1] https://www.npmjs.com/package/swiped-events

Signed-off-by: Markus Heiser <markus.heiser@darmarit.de>
 2025-01-20 13:52:43 +01:00
Markus Heiser d9115b8d48 [build] /static 2025-01-20 13:29:26 +01:00
Markus Heiser 41159fed32 [build] /static 2025-01-16 10:51:33 +01:00
Markus Heiser b1507f188e [fix] gallery view overlaps category bar 
Closes: https://github.com/searxng/searxng/issues/4190

Signed-off-by: Markus Heiser <markus.heiser@darmarit.de>
 2025-01-16 10:51:33 +01:00
Markus Heiser 1668ff5e64 [fix] theme simple: image viewer hides autocomplete suggestions 
Closes: https://github.com/searxng/searxng/issues/3509
Signed-off-by: Markus Heiser <markus.heiser@darmarit.de>
 2025-01-16 10:51:33 +01:00
Markus Heiser f03ab00155 [fix] broken mobile view (from #4154) 
Related:
- https://github.com/searxng/searxng/pull/4154#issuecomment-2591881963

Closes: https://github.com/searxng/searxng/issues/4187

Signed-off-by: Markus Heiser <markus.heiser@darmarit.de>
 2025-01-16 10:51:33 +01:00
Markus Heiser 15d0e274b3 [fix] build workflows of the themes 
Signed-off-by: Markus Heiser <markus.heiser@darmarit.de>
 2025-01-16 10:51:33 +01:00
Markus Heiser e4f8f0483f [mod] slightly improve make node.clean themes.all 
Signed-off-by: Markus Heiser <markus.heiser@darmarit.de>
 2025-01-14 15:22:23 +01:00
Markus Heiser 9d834c0722 [fix] issues reported by sytlelint 
"Unexpected vendor-prefixed":
   -webkit-transform & -ms-transform [3]
   -webkit-animation [2]
   @-webkit-keyframes [1]

[1] https://developer.mozilla.org/en-US/docs/Web/CSS/@keyframes
[2] https://developer.mozilla.org/en-US/docs/Web/CSS/animation
[3] https://developer.mozilla.org/en-US/docs/Web/CSS/transform

Signed-off-by: Markus Heiser <markus.heiser@darmarit.de>
 2025-01-14 15:22:23 +01:00
Markus Heiser 0abad23daa [upd] migrate .eslintrc.json to eslint.config.mjs 
The migration was done by the following steps, firts prepare the node enviroment
an open a bash in this environment::

    $ make clean nvm.nodejs
    ...
    $ ./manage nvm.bash
    $ which npx
    searxng/.nvm/versions/node/v23.5.0/bin/npx

In this environment the migration command from [1] is started::

    $ npx @eslint/migrate-config .eslintrc.json
    Need to install the following packages:
    @eslint/migrate-config@1.3.5
    Migrating .eslintrc.json

    Wrote new config to ./eslint.config.mjs

    You will need to install the following packages to use the new config:
    - globals
    - @eslint/js
    - @eslint/eslintrc

    You can install them using the following command:

    npm install globals @eslint/js @eslint/eslintrc -D

    The following messages were generated during migration:
    - The 'node' environment is used, so switching sourceType to 'commonjs'.

[1] https://eslint.org/docs/latest/use/configure/migration-guide#migrate-your-config-file

Signed-off-by: Markus Heiser <markus.heiser@darmarit.de>
 2025-01-14 15:22:23 +01:00
Markus Heiser 943c8fb85b [upd] update npm dependencies (package.json) and .tool-versions 
To avoid issue like [1], versions from now on are pinned in::

    searx/static/themes/simple/package-lock.json

To test nodejs v23 or newer is needed (will be installed by nvm).  To drop a
possibly existing installation::

    $ make clean

Install nodejs in nvm::

    $ make nvm.nodejs
    INFO:  install (update) NVM at searxng/.nvm
    ...
    Now using node v23.5.0 (npm v10.9.2)
    Creating default alias: default -> v23.5 (-> v23.5.0)
    INFO:  Node.js is installed at searxng/.nvm/versions/node/v23.5.0/bin/node
    INFO:  Node.js is version v23.5.0
    INFO:  npm is installed at searxng/.nvm/versions/node/v23.5.0/bin/npm
    INFO:  npm is version 10.9.2
    INFO:  NVM is installed at searxng/.nvm

To test npm checks and builds:

    $ make static.build.commit

Related:

[1] https://github.com/searxng/searxng/issues/4143

Signed-off-by: Markus Heiser <markus.heiser@darmarit.de>
 2025-01-14 15:22:23 +01:00
Markus Heiser 09cce18518 [data] update searx.data - make data.all 
Signed-off-by: Markus Heiser <markus.heiser@darmarit.de>
 2025-01-13 08:02:01 +01:00
Markus Heiser 6dab7fe78b Revert "[l10n ga] trigger weblate.push.translations (another try)" 
This reverts commit e352926187.
 2025-01-06 17:12:16 +01:00
Markus Heiser e352926187 [l10n ga] trigger weblate.push.translations (another try) 
Related:

- https://github.com/searxng/searxng/issues/4117

Signed-off-by: Markus Heiser <markus.heiser@darmarit.de>
 2025-01-06 16:59:20 +01:00
Markus Heiser b0391fe718 reomve DUMMY from searxng.msg catalog 
Signed-off-by: Markus Heiser <markus.heiser@darmarit.de>
 2025-01-06 16:24:44 +01:00
Markus Heiser 91d3d38690 [l10n ga] trigger weblate.push.translations 
Signed-off-by: Markus Heiser <markus.heiser@darmarit.de>
 2025-01-06 16:16:04 +01:00
Markus Heiser c5991865c8 [fix] l10n ga (Irish) messages.po is marked as fuzzy 
$ ./manage pyenv.cmd pybabel compile --statistics -d searx/translations/

reports:

    catalog searx/translations/ga/LC_MESSAGES/messages.po is marked as fuzzy, skipping

This commit removes the ``fuzzy`` tag and BTW reverts commit 655e41f27

Signed-off-by: Markus Heiser <markus.heiser@darmarit.de>
 2025-01-06 15:49:21 +01:00
Markus Heiser 655e41f274 [l10n ga] trigger weblate.push.translations 
Related:

- https://github.com/searxng/searxng/issues/4117

Signed-off-by: Markus Heiser <markus.heiser@darmarit.de>
 2025-01-06 14:54:41 +01:00
Markus Heiser c1bb0bebd4 [data] update searx.data - update_engine_traits.py 
Signed-off-by: Markus Heiser <markus.heiser@darmarit.de>
 2024-12-29 10:12:45 +01:00
Markus Heiser af3f272b0b [fix] update_engine_traits.py: annas archive, bing-* and zlibrary engines 
Github action Update data - update_engine_traits [1] had issues in annas
archive, bing-* and zlibrary engines:

    ./manage pyenv.cmd python ./searxng_extra/update/update_engine_traits.py

[1] https://github.com/searxng/searxng/actions/runs/12530827768/job/34953392587

Signed-off-by: Markus Heiser <markus.heiser@darmarit.de>
 2024-12-29 10:12:45 +01:00
Markus Heiser 9e32cd2047 [fix] replaca inoffical msgspec-python313-pre by offical msgspec 0.19 
inoffical msgspec-python313-pre was an inetrim solution from e710ebdf6

related:

- https://github.com/searxng/searxng/pull/4129
- https://github.com/jcrist/msgspec/issues/764#issuecomment-2561330165

closes:

- https://github.com/searxng/searxng/issues/4015

Signed-off-by: Markus Heiser <markus.heiser@darmarit.de>
 2024-12-28 10:42:20 +01:00
Markus Heiser 3749154660 [mod] add support for Python 3.13 
Python 3.13 has been released [1]

- fasttext-predict supports py3.13 from version 0.9.2.3 [2]

[1] https://www.python.org/downloads/release/python-3130/
[2] https://github.com/searxng/fasttext-predict/commit/f2da9cd173

Signed-off-by: Markus Heiser <markus.heiser@darmarit.de>
 2024-12-24 19:46:04 +01:00
Markus Heiser e710ebdf67 [fix] temporary msgspec-python313-pre 
Waitng for new release of msgspec for Python 3.13:

- https://github.com/jcrist/msgspec/issues/764#issuecomment-2466150924

Signed-off-by: Markus Heiser <markus.heiser@darmarit.de>
 2024-12-24 19:35:54 +01:00
Markus Heiser 26097f444b [fix] engine google_video: google changed the layout of the HTML response 
Closes: https://github.com/searxng/searxng/issues/4127
Signed-off-by: Markus Heiser <markus.heiser@darmarit.de>
 2024-12-22 11:45:46 +01:00
Markus Heiser 65c970bdf4 [build] /static 2024-12-16 11:39:38 +01:00
Markus Heiser 1604a00b89 Revert "[weblate] add dummy string to trigger weblate.push.translations in CI" 
This reverts commit 899edee5ec.
 2024-12-16 09:27:19 +01:00
Markus Heiser 899edee5ec [weblate] add dummy string to trigger weblate.push.translations in CI 
Signed-off-by: Markus Heiser <markus.heiser@darmarit.de>
 2024-12-16 08:41:57 +01:00
Markus Heiser c60fe999cf Update data - locales 
./searxng_extra/update/update_locales.py

Signed-off-by: Markus Heiser <markus.heiser@darmarit.de>
 2024-12-13 18:45:14 +01:00
Markus Heiser f952668fde [l10n] adding new language Tatar (tt) 
$ ./manage pyenv.cmd bash
    $ pybabel init -i searx/translations/messages.pot -d searx/translations -l tt
    creating catalog searx/translations/tt/LC_MESSAGES/messages.po based on searx/translations/messages.pot

Closes: https://github.com/searxng/searxng/issues/4098

Signed-off-by: Markus Heiser <markus.heiser@darmarit.de>
 2024-12-13 18:45:14 +01:00
Markus Heiser 0245e82bd2 [build] /static 2024-12-01 15:04:05 +01:00
Markus Heiser 8c3f0c3d52 [fix] if image load fails on client side, show default image 
BTW: change icon color from red to gray

Closes:

- https://github.com/searxng/searxng/issues/4066

Signed-off-by: Markus Heiser <markus.heiser@darmarit.de>
 2024-12-01 15:04:05 +01:00
Markus Heiser bb04699b17 [fix] unit tests: call searx.search.initialize in test's setUp 
Depending on the order the unit tests are executed, the searx.search module is
initalized or not, issue reported in [1]::

    Traceback (most recent call last):
      File "searxng/tests/unit/test_results.py", line 72, in test_result_merge_by_title
        self.container.extend('stract', [fake_result(engine='stract', title='short title')])
      File "searxng/searx/results.py", line 243, in extend
        histogram_observe(standard_result_count, 'engine', engine_name, 'result', 'count')
      File "searxng/searx/metrics/__init__.py", line 49, in histogram_observe
        histogram_storage.get(*args).observe(duration)
        ^^^^^^^^^^^^^^^^^^^^^
      AttributeError: 'NoneType' object has no attribute 'get'

To ensure that the searx.search module is initialized, the

- searx.engines.load_engines is replace by
- searx.search.initialize

[1] https://github.com/searxng/searxng/pull/3932#discussion_r1822406569

Signed-off-by: Markus Heiser <markus.heiser@darmarit.de>
 2024-11-29 15:26:03 +01:00
Markus Heiser 605f38b352 [fix] update_currencies.py: github CI has longer timeouts 
Github action Update data - update_currencies [1]:

    ./manage pyenv.cmd python ./searxng_extra/update/update_currencies.py

fails with ``httpcore.ReadTimeout`` / the default timeout is 3sec.

[1] https://github.com/searxng/searxng/actions/runs/12076864366/job/33703464399

Signed-off-by: Markus Heiser <markus.heiser@darmarit.de>
 2024-11-29 14:50:17 +01:00
Markus Heiser 540323a4b0 [mod] hardening xpath engine: ignore empty results 
A SearXNG maintainer on Matrix reported a traceback::

    File "searxng-src/searx/engines/xpath.py", line 272, in response
      dom = html.fromstring(resp.text)
            ^^^^^^^^^^^^^^^^^^^^^^^^^^
    File "searx-pyenv/lib/python3.11/site-packages/lxml/html/__init__.py", line 850, in fromstring
      doc = document_fromstring(html, parser=parser, base_url=base_url, **kw)
            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
    File "searx-pyenv/lib/python3.11/site-packages/lxml/html/__init__.py", line 738, in document_fromstring
      raise etree.ParserError(
    lxml.etree.ParserError: Document is empty

I don't have an example to reproduce the issue, but the issue and this patch are
clearly recognizable even without an example.

Signed-off-by: Markus Heiser <markus.heiser@darmarit.de>
 2024-11-29 14:20:31 +01:00
Markus Heiser 7b6b772e34 [fix] wikicommons engine: remove HTML tags from result items 
BTW: humanize filesize (Bytes) to KB, MB, GB ..

Signed-off-by: Markus Heiser <markus.heiser@darmarit.de>
 2024-11-28 06:05:45 +01:00
Markus Heiser 342d321196 [fix] google engine: remove <script> tags from result items 
In some results, Google returns a <script> tag that must be removed before
extracting the content.

Signed-off-by: Markus Heiser <markus.heiser@darmarit.de>
 2024-11-27 13:49:45 +01:00
Markus Heiser 78f5300830 [chore] drop sjp engine: WEB side has changed a long time ago 
The WEB page (PL only) has changed and there is now also a kind of CAPTCHA.
There is currently no possibility to restore the function of this engine.

Signed-off-by: Markus Heiser <markus.heiser@darmarit.de>
 2024-11-26 15:45:02 +01:00
Markus Heiser ac0c6cc2d1 [chore] remove invalid base_url from settings.yml engines 
The engines do not have / do not need a property `base_url`, lets remove it from
the settings.yml

Signed-off-by: Markus Heiser <markus.heiser@darmarit.de>
 2024-11-26 10:06:07 +01:00
Markus Heiser 36a6f9c95f [fix] engine: Library of Congress - image & thumb links 
The properties `item.service_medium` and `item.thumb_gallery` are not given for
every result item.  It is more reliable to use the first (thumb) and
last (image) URL in the list of of URLs in `image_url`.

Signed-off-by: Markus Heiser <markus.heiser@darmarit.de>
 2024-11-26 09:36:59 +01:00
Markus Heiser cf8c36f351 [mod] add CSS (LESS) to xsl style to view rss in browser 
Signed-off-by: Markus Heiser <markus.heiser@darmarit.de>
 2024-11-25 09:34:02 +01:00
Markus Heiser 5fbea0b62d [refactor] <type> element isn't a part of the RSS 2.0 spec [1] 
[1] https://cyber.harvard.edu/rss/rss.html

Signed-off-by: Markus Heiser <markus.heiser@darmarit.de>
 2024-11-25 09:34:02 +01:00
Markus Heiser 7927baf545 [upd] github CI: actions/cache@v3 to actions/cache@v4 
Signed-off-by: Markus Heiser <markus.heiser@darmarit.de>
 2024-11-24 14:07:07 +01:00
Markus Heiser 0253c10b52 [feat] engine: add adobe stock video and audio engines 
The engine has been revised; there is now the option ``adobe_content_types``
with which it is possible to configure engines for video and audio from the
adobe stock.  BTW this patch adds documentation to the engine.

To test all three engines in one use a search term like::

    !asi !asv !asa sound

Signed-off-by: Markus Heiser <markus.heiser@darmarit.de>
 2024-11-24 11:56:12 +01:00
Markus Heiser 0f9694c90b [clean] Internet Archive Scholar search API no longer exists 
Engine was added in #2733 but the API does no longer exists. Related:

- https://github.com/searxng/searxng/issues/4038

Signed-off-by: Markus Heiser <markus.heiser@darmarit.de>
 2024-11-23 17:59:38 +01:00
Markus Heiser ccc4f30b20 [doc] update quantities on the intro page 
The quantities on the intro page were partly out of date / example; we already
have 210 engines and not just 70. To avoid having to change the quantities
manually in the future, they are now calculated from the jinja context

Signed-off-by: Markus Heiser <markus.heiser@darmarit.de>
 2024-11-23 16:33:08 +01:00
Markus Heiser c4b874e9b0 [fix] engine Library of Congress: fix API URL loc.gov -> www.loc.gov 
Avoid HTTP 404 and redirects. Requests to the JSON/YAML API use the base url [1]

    https://www.loc.gov/{endpoint}/?fo=json

[1] https://www.loc.gov/apis/json-and-yaml/requests/

Signed-off-by: Markus Heiser <markus.heiser@darmarit.de>
 2024-11-23 13:02:24 +01:00
Markus Heiser 7c4e4ebd40 [log] warning with URL in case of 'raise_for_httperror' 
In order to be able to implement error handling, it is necessary to know which
URL triggered the exception / the URL has not yet been logged.

Signed-off-by: Markus Heiser <markus.heiser@darmarit.de>
 2024-11-23 11:33:19 +01:00
Markus Heiser 10d3af84b8 [fix] engine: duckduckgo - don't quote query string 
The query string send to DDG must not be qouted.

The query string was URL-qouted in #4011, but the URL-qouted query string result
in unexpected *URL decoded* and other garbish results as reported in #4019
and #4020.  To test compare the results of a query like::

    !ddg Häuser und Straßen :de
    !ddg Häuser und Straßen :all
    !ddg 房屋和街道 :all
    !ddg 房屋和街道 :zh

Closed:

- [#4019] https://github.com/searxng/searxng/issues/4019
- [#4020] https://github.com/searxng/searxng/issues/4020

Related:

- [#4011] https://github.com/searxng/searxng/pull/4011

Signed-off-by: Markus Heiser <markus.heiser@darmarit.de>
 2024-11-17 18:14:22 +01:00
Markus Heiser c4055e449f [fix] issues reported by make test.yamllint 
Signed-off-by: Markus Heiser <markus.heiser@darmarit.de>
 2024-11-06 08:16:21 +01:00
Markus Heiser 2fdbf2622b [mod] lint github YAML config files 
Signed-off-by: Markus Heiser <markus.heiser@darmarit.de>
 2024-11-06 08:16:21 +01:00
Markus Heiser 56e3d72a76 [fix] CI: remove target test.coverage from python's test matrix 
The test.coverage cause a lot of failed CI jobs for reasons that cannot be
explained.  As we do not monitor the coverage anyway, it is superfluous to run
this job, especially as it only has a disruptive effect on the CI.

BTW and the CI action upload-artifact@v3 is deprecated [1]

[1] https://github.com/actions/upload-artifact?tab=readme-ov-file#actionsupload-artifact

Related: https://github.com/searxng/searxng/issues/3983
Signed-off-by: Markus Heiser <markus.heiser@darmarit.de>
 2024-11-01 10:14:57 +01:00
Markus Heiser fa4dfd4efe [fix] favicons: msgspec.ValidationError: Expected Path, got str - at $.favicons.cache.db_url 
Closes: https://github.com/searxng/searxng/issues/3975
Signed-off-by: Markus Heiser <markus.heiser@darmarit.de>
 2024-10-29 18:22:22 +01:00
Markus Heiser b183e620d8 [refactor] engine: duckduckgo - https://html.duckduckgo.com/html 
The entire source code of the duckduckgo engine has been reengineered and
purified.

1. DDG used the URL https://html.duckduckgo.com/html for no-JS requests whose
   response is also easier to parse than the previous
   https://lite.duckduckgo.com/lite/ URL

2. the bot detection of DDG has so far caused problems and often led to a
   CAPTCHA, this can be circumvented using `'Sec-Fetch-Mode'] = “navigate”`

Closes: https://github.com/searxng/searxng/issues/3927
Signed-off-by: Markus Heiser <markus.heiser@darmarit.de>
 2024-10-29 14:56:27 +01:00
Markus Heiser f63f97c56c Revert "Fix for broken docker builds" 
This reverts commit 4ef1c706f8.
 2024-10-29 13:50:38 +01:00
Markus Heiser 163031c394 Revert "[fix] typo in Dockerfile" 
This reverts commit 038a2ff6bd.
 2024-10-29 13:50:38 +01:00
Markus Heiser 3e5621e1af [refactor] replace pydantic by msgspec 
Signed-off-by: Markus Heiser <markus.heiser@darmarit.de>
 2024-10-29 13:50:38 +01:00
Markus Heiser b176323e89 [fix] calculator: use locale from UI (not from selected language) 
Closes: https://github.com/searxng/searxng/issues/3956
Signed-off-by: Markus Heiser <markus.heiser@darmarit.de>
 2024-10-28 15:53:57 +01:00
Markus Heiser da28f5280b [fix] limiter: don't hard code settings folder to /etc/searxng 
The location of the local settings depends on environment ``SEARXNG_SETTINGS_PATH``
and can be different from ``/etc/searxng``.  Issue was reported on Matrix [1].

To get the location function ``searx.settings_loader.get_user_cfg_folder()``
should be used.

[1] https://matrix.to/#/!vxScbLNEAmRvOraXBn:matrix.org/$_eLS0JpE9oVEWsiGJkqJnWcFWEeZClIMGDK6cWv_Q4g?via=matrix.org&via=tchncs.de&via=envs.net

Signed-off-by: Markus Heiser <markus.heiser@darmarit.de>
 2024-10-28 12:51:05 +01:00
Markus Heiser e08ff05fff [fix] add missing tomli to the requirements.txt 
Package ``tomli`` is needed for py < 3.11, BTW remove the no longer needed
pytomlpp package.

Signed-off-by: Markus Heiser <markus.heiser@darmarit.de>
 2024-10-26 15:59:42 +02:00
Markus Heiser a3921b5ed7 [mod] add test to check compat.py module 
Signed-off-by: Markus Heiser <markus.heiser@darmarit.de>
 2024-10-26 15:59:42 +02:00
Markus Heiser ae496e9dd0 [build] /static 2024-10-26 08:34:21 +02:00
Markus Heiser b14d885f23 [fix] favicons: don't hard code settings folder to /etc/searxng 
The location of the local settings depends on environment ``SEARXNG_SETTINGS_PATH``
and can be different from ``/etc/searxng``.  Issue was reported on Matrix [1].

To get the location function ``searx.settings_loader.get_user_cfg_folder()``
should be used.

[1] https://matrix.to/#/!vxScbLNEAmRvOraXBn:matrix.org/$5xNMYvONGB-mPt2B3ttoL27QncRFhkjGkO-TISdmP08?via=matrix.org&via=tchncs.de&via=envs.net

Signed-off-by: Markus Heiser <markus.heiser@darmarit.de>
 2024-10-23 05:29:15 +02:00
Markus Heiser 050451347b [fix] engine: duckduckgo - CAPTCHA detection 
The previous implementation could not distinguish a CAPTCHA response from an
ordinary result list.  In the previous implementation a CAPTCHA was taken as a
result list where no items are in.

DDG does not block IPs.  Instead, a CAPTCHA wall is placed in front of request
on a dubious request.

Signed-off-by: Markus Heiser <markus.heiser@darmarit.de>
 2024-10-19 14:55:44 +02:00
Markus Heiser 038a2ff6bd [fix] typo in Dockerfile 
Signed-off-by: Markus Heiser <markus.heiser@darmarit.de>
 2024-10-17 19:57:33 +02:00
Markus Heiser 058a072404 [build] /static 2024-10-15 15:54:58 +02:00
Markus Heiser 14fb187548 [fix] stretching pics in "pic search" 
Issue is described in:

- https://github.com/searxng/searxng/issues/3915

The issue was caused bei merge of PR:

- https://github.com/searxng/searxng/pull/3895

Solution:

- Unset `width` for objects of class `.result-images`.

Tested by `make run` and query a list of results, containing `.result` and
`.result-images` objects:

     !images !go bäder :de

Signed-off-by: Markus Heiser <markus.heiser@darmarit.de>
Closes: https://github.com/searxng/searxng/issues/3915
 2024-10-15 15:54:58 +02:00
Markus Heiser c96ba25f5b [fix] online_currency.py: if more alternatives, use the last in the list 
If there are more than one ISO 4217 numeric codes [1] for a currency use the
last one in the list of alternatives [2].

[1] https://en.wikipedia.org/wiki/ISO_4217#Active_codes_(list_one)
[2] https://en.wikipedia.org/wiki/ISO_4217#Historical_codes

Closes: https://github.com/searxng/searxng/issues/3713
Signed-off-by: Markus Heiser <markus.heiser@darmarit.de>
 2024-10-15 15:20:39 +02:00
Markus Heiser e275f8e18e [data] update searx.data - update_engine_traits.py 
Patches generated by::

    make data.traits

Signed-off-by: Markus Heiser <markus.heiser@darmarit.de>
 2024-10-15 06:37:01 +02:00
Markus Heiser 7e8b330b3e [build] /static 2024-10-12 11:08:44 +02:00
Markus Heiser 2fbedc4316 [fix] simple theme: fix deformed result item 
Setting ``box-sizing: border-box;`` [1] and ``width`` to fix deformed results
reported in [2].

[1] https://developer.mozilla.org/en-US/docs/Web/CSS/box-sizing
[2] https://github.com/searxng/searxng/issues/3892

Closes: #3892

Signed-off-by: Markus Heiser <markus.heiser@darmarit.de>
 2024-10-12 11:08:44 +02:00
Markus Heiser f1f0dfd231 Revert "[fix] docker: alpine - install apk py3-pydantic-core" 
This reverts commit 5332d3a0b8.
 2024-10-07 13:18:54 +02:00
Markus Heiser 5332d3a0b8 [fix] docker: alpine - install apk py3-pydantic-core 
Alpine Linux uses musl libc (instead of glibc). However, there is no pre-build
of the pydantic-core python package for musl lib on armv7.  Alternatively this
patch installs py3-pydantic-core from Alpine packages [1]

[1] https://pkgs.alpinelinux.org/package/edge/community/armv7/py3-pydantic-core

- closes: https://github.com/searxng/searxng/issues/3887

Signed-off-by: Markus Heiser <markus.heiser@darmarit.de>
 2024-10-06 11:59:57 +02:00
Markus Heiser f00fa76eda [build] /static 2024-10-05 08:18:28 +02:00
Markus Heiser a631f77401 [mod] favicons: simplify RTL in template & CSS 
Comes from a sughgestion in:

- https://github.com/searxng/searxng/pull/3727#issuecomment-2388998803

Suggested-by: Bnyro <bnyro@tutanota.com>
Signed-off-by: Markus Heiser <markus.heiser@darmarit.de>
 2024-10-05 08:18:28 +02:00
Markus Heiser a7d02d4101 [doc] documentation of the favicons infrastructure 
Run ``make docs.live`` and visit http://0.0.0.0:8000/admin/searx.favicons.html

Signed-off-by: Markus Heiser <markus.heiser@darmarit.de>
 2024-10-05 08:18:28 +02:00
Markus Heiser 5ded9ada82 [mod] UI: add favicon's border- and background color to the definitons 
Signed-off-by: Markus Heiser <markus.heiser@darmarit.de>
 2024-10-05 08:18:28 +02:00
Markus Heiser 7ab577a1fb [mod] Revision of the favicon solution 
All favicons implementations have been documented and moved to the Python
package:

    searx.favicons

There is a configuration (based on Pydantic) for the favicons and all its
components:

    searx.favicons.config

A solution for caching favicons has been implemented:

    searx.favicon.cache

If the favicon is already in the cache, the returned URL is a data URL [1]
(something like `data:image/png;base64,...`).  By generating a data url from
the FaviconCache, additional HTTP roundtripps via the favicon_proxy are saved:

    favicons.proxy.favicon_url

The favicon proxy service now sets a HTTP header "Cache-Control: max-age=...":

    favicons.proxy.favicon_proxy

The resolvers now also provide the mime type (data, mime):

    searx.favicon.resolvers

[1] https://developer.mozilla.org/en-US/docs/Web/HTTP/Basics_of_HTTP/Data_URLs

Signed-off-by: Markus Heiser <markus.heiser@darmarit.de>
 2024-10-05 08:18:28 +02:00
Markus Heiser c49a2707c1 [mod] sqlitedb: access to SQLite databases a little more convenient. 
Signed-off-by: Markus Heiser <markus.heiser@darmarit.de>
 2024-10-05 08:18:28 +02:00
Markus Heiser 2fd6730d4f [mod] py3.8 EOL / upgrade to actions/setup-python@v5 
Signed-off-by: Markus Heiser <markus.heiser@darmarit.de>
 2024-10-03 13:05:43 +02:00
Markus Heiser e7a4d7d7c3 [doc] slightly improve documentation of SQL engines 
Signed-off-by: Markus Heiser <markus.heiser@darmarit.de>
 2024-10-03 13:04:06 +02:00
Markus Heiser d48f04e809 [build] /static 2024-10-03 11:05:46 +02:00
Markus Heiser f07ab6deb0 [data] update searx.data - update_engine_traits.py 
Signed-off-by: Markus Heiser <markus.heiser@darmarit.de>
 2024-09-29 14:29:22 +02:00
Markus Heiser d026486ce3 [fix] scripts: elimination of limitations on dedicated distributions 
The restriction of shell scripts to certain distributions is only required for
certain actions such as the installation of a SearXNG instance. The maintenance
scripts and build processes were previously also restricted to these specific
distributions.  With this patch, the build processes (such as the build of
online documentation) can now also be executed on all Linux distributions.

Signed-off-by: Markus Heiser <markus.heiser@darmarit.de>
 2024-09-19 09:35:54 +02:00
Markus Heiser 9eda4044be [fix] bilibili engine - ValueError in duration & HTML in title 
- ValueError in duration: issue reported in #3799
- HTML in title: related to #3770

[#3799] https://github.com/searxng/searxng/issues/3799
[#3770] https://github.com/searxng/searxng/pull/3770

Signed-off-by: Markus Heiser <markus.heiser@darmarit.de>
 2024-09-06 07:13:47 +02:00
Markus Heiser b774ee04ba [mod] enable calculator and allow plugin on public instances 
Remove quirks that prevented the Calculator from being used on public instances.

Signed-off-by: Markus Heiser <markus.heiser@darmarit.de>
 2024-09-03 18:36:28 +02:00
Markus Heiser 3a3ff8f020 [mod] hardening "calculator plugin" / limit execution time to 50 ms 
The execution of the function for the calculation is outsourced to a process
whose runtime is limited to 50 milliseconds.

Related:

- [1] https://github.com/searxng/searxng/pull/3377#issuecomment-2067977375

Signed-off-by: Markus Heiser <markus.heiser@darmarit.de>
 2024-09-03 18:36:28 +02:00
Markus Heiser fe6bac5a08 [fix] pip install -e: legacy editable install (setup.py develop) is deprecated 
From [1]: There is now a standardized mechanism [2] for an installer like pip to
request an editable install of a project.  pip is transitioning to using this
standard only instead of invoking the deprecated `setup.py develop` command.

For backward compatibility, we can use switches:

--use-pep517
  https://pip.pypa.io/en/stable/cli/pip_install/#cmdoption-use-pep517

--no-build-isolation
  https://pip.pypa.io/en/stable/cli/pip_install/#cmdoption-no-build-isolation

- [1] https://github.com/pypa/pip/issues/11457
- [2] https://peps.python.org/pep-0660/

Closes: https://github.com/searxng/searxng/issues/3701
Signed-off-by: Markus Heiser <markus.heiser@darmarit.de>
 2024-08-21 12:09:14 +02:00
Markus Heiser 5be55e3309 [fix] unit tests: fix load / unload engines & fix messages 
- https://github.com/searxng/searxng/pull/3746#issuecomment-2300965005
- https://github.com/searxng/searxng/issues/2988#issuecomment-2226929084

Signed-off-by: Markus Heiser <markus.heiser@darmarit.de>
 2024-08-21 08:28:13 +02:00
Markus Heiser 5c6b126d7f [fix] debian/ubuntu python-is-python3 
Closes: https://github.com/searxng/searxng/issues/3235
Signed-off-by: Markus Heiser <markus.heiser@darmarit.de>
 2024-08-20 20:20:50 +02:00
Markus HeiserandJoel Carnat @jcarnat https://github.com/jcarnat 799d72e3fd [mod] add French translation for infopage 
The French translation was provided by @jcarnat in #3738.

[3738] https://github.com/searxng/searxng/issues/3738

Co-authored-by: Joel Carnat @jcarnat https://github.com/jcarnat
Signed-off-by: Markus Heiser <markus.heiser@darmarit.de>
 2024-08-20 07:25:39 +02:00
Markus Heiser 8d14d46c00 [build] /static 2024-08-15 18:58:28 +02:00
Markus Heiser 45f03f1902 [fix] search box: clear button don't appear on mouse-copy 
You have to copy and paste the query without using the keyboard to replicate the
issue. As soon as you press the keyboard the cross appears. [1]

- [1] https://github.com/searxng/searxng/issues/3725#issuecomment-2282655272

Reported-by: @Immortality-IMT in [1]
Signed-off-by: Markus Heiser <markus.heiser@darmarit.de>
 2024-08-15 18:58:28 +02:00