Alexandre Flament
9e9f57e48b
Merge pull request #1954 from dalf/fix.redis.init.2
...
[fix] follow up of PR-1856
2022-12-14 07:08:19 +01:00
Markus Heiser
ed901ab18e
[mod] improve 'Autodetect search language' plugin
...
- Add documentation to the plugin
- Harmonize FastText language model with SearXNG's language model
Reosurces::
import fasttext # --> +10 MB
fasttext.load_model(str(data_dir / 'lid.176.ftz')) # --> +4MB
Suggested-by: @dalf
- To speed up and simplify the deployment use fasttext-wheel instead of fasttext
- Building numpy on the Alpine Linux of docker-images takes ages --> install
py3-numpy from Alpines package manager (apk)
- Alpine Linux on docker-images (musl libc) do not support fasttext-wheel (gnu
libc) --> patch Dockerfile and build from fastetxt:
sed -i s/fasttext-wheel/fasttext/ requirements.txt
Signed-off-by: Markus Heiser <markus.heiser@darmarit.de>
2022-12-11 11:26:07 +01:00
ArtikusHG
9925a20950
[mod] new plugin: Autodetect search language
2022-12-10 13:11:47 +01:00
Alexandre Flament
b971167ced
move searx.shared.redisdb to searx.redisdb
2022-12-10 09:26:38 +01:00
Alexandre Flament
34e260f88f
[fix] follow up of PR-1856
...
- the environment variable SEARXNG_REDIS_URL overrides the setting value redis.url
- ./manage sets SEARXNG_REDIS_URL to unix:///usr/local/searxng-redis/run/redis.sock if:
- the socket exists
- SEARXNG_REDIS_URL is not already defined
Update of PR #1856
Co-authored-by: Markus Heiser <markus.heiser@darmarit.de>
2022-12-10 09:26:38 +01:00
searxng-bot
759d53c892
[translations] update from Weblate
...
1b4600d0e3b49827975217cf
2022-12-09 07:15:14 +00:00
Alexandre Flament
269326063a
Fix: don't crash when engine or name is missing in settings.yml
...
SearXNG crashes if the engine or name fields are missing.
With this commit, the app displays an error in the log and keeps loading.
Close #1951
2022-12-04 23:43:59 +01:00
searxng-bot
f40d1c0004
[translations] update from Weblate
...
cc5cf5d897776fbfc3c9f988a1cf339e4429167c
2022-12-02 07:15:43 +00:00
Ryan Kaskel
e19218c6a9
Copy client connection kwargs before mutating
2022-11-29 12:15:18 +00:00
Markus Heiser
a8359dd4d3
Merge pull request #1981 from searxng/update_data_update_firefox_version.py
...
Update searx.data - update_firefox_version.py
2022-11-29 07:48:26 +01:00
Markus Heiser
1b2f1c17f6
Merge pull request #1982 from searxng/update_data_update_wikidata_units.py
...
Update searx.data - update_wikidata_units.py
2022-11-29 07:47:52 +01:00
Markus Heiser
3579a38a2d
Merge pull request #1983 from searxng/update_data_update_currencies.py
...
Update searx.data - update_currencies.py
2022-11-29 07:46:49 +01:00
Markus Heiser
82af2f4460
Merge pull request #1984 from searxng/update_data_update_ahmia_blacklist.py
...
Update searx.data - update_ahmia_blacklist.py
2022-11-29 07:45:51 +01:00
dalf
a508cdbd4b
Update searx.data - update_engine_descriptions.py
2022-11-29 01:34:42 +00:00
dalf
c4512cf64d
Update searx.data - update_ahmia_blacklist.py
2022-11-29 01:24:48 +00:00
dalf
b0b45fd2d0
Update searx.data - update_currencies.py
2022-11-29 01:24:39 +00:00
dalf
a9be73b4da
Update searx.data - update_wikidata_units.py
2022-11-29 01:24:38 +00:00
dalf
9fc72419e1
Update searx.data - update_firefox_version.py
2022-11-29 01:24:35 +00:00
searxng-bot
981a2c9626
[translations] update from Weblate
...
c13727fc21f638f6b8ed9e1c
2022-11-25 07:16:11 +00:00
fehho
7cab51f98f
Deserialize explicitly blank strings
...
Default behavior of urllib.parse_qs is to discard blank values, causing a preference of none to be deserialized as undefined, using the instance default rather than the selected preference.
2022-11-24 13:14:12 -06:00
searxng-bot
9d06115d07
[translations] update from Weblate
...
7569f2666418da9aacc0dc1a6c2beba6b49457e3
2022-11-19 16:21:15 +00:00
searxng-bot
7a39952558
[translations] update from Weblate
...
f123be21fa2cfa8f
2022-11-18 07:17:51 +00:00
Émilien Devos
46ad32343a
Switch back to protobuf for raw HTML
2022-11-11 07:39:48 +00:00
ngosang
78be4b4c70
Fix Google search engine.
...
- Fix broken links. Resolves #1794
- Fix missing results. Resolves #1829
2022-11-11 07:34:19 +01:00
Ryan Draga
408200c87e
[fix] disabling zlibrary due to z-lib.org domain seizure
2022-11-10 21:18:21 +01:00
Markus Heiser
ee4475ff4b
Merge pull request #1934 from dalf/fix_user_agent
...
User agent: don't include the patch number in the Firefox version
2022-11-09 06:50:33 +01:00
Alexandre FLAMENT
73b5a58d9e
[FIX] Redis initialization
...
redis.Redis.from_url(url) doesn't check if the url is valid
Before this commit: actual error are detected later when the client is actually used.
With this commit, client() makes sure to return a valid Redis client or None.
Also, the code makes sure not to log the password of the Redis URL
2022-11-07 22:08:32 +00:00
Alexandre Flament
8f19bdaf17
Merge pull request #1882 from fehho/metacpan
...
Add MetaCPAN engine
2022-11-07 21:54:11 +01:00
fehho
fe351c2802
Add MetaCPAN engine
2022-11-07 08:07:06 -06:00
Evhorizon
1517724615
Update network.py
2022-11-06 20:35:30 +01:00
Alexandre Flament
2dc5c0e1d6
Merge pull request #1928 from searxng/translations_update
...
Update translations
2022-11-06 11:29:28 +01:00
Alexandre Flament
4fe5463671
Merge pull request #1869 from vgerak/1836-ddg-weather
...
Fix floating point format in DDG weather humidity
2022-11-05 22:46:50 +01:00
Alexandre FLAMENT
d8dee21277
searx.locale: add Dhivehi language
2022-11-05 21:26:15 +00:00
Alexandre FLAMENT
20d951fc5c
searx.locales: improve support for languages not supported by babel
...
* refactor get_translations() to rely on ADDITIONAL_TRANSLATIONS and LOCALE_BEST_MATCH
* update RTL_LOCALES for languages in ADDITIONAL_TRANSLATIONS
2022-11-05 21:26:07 +00:00
Alexandre Flament
e473addaff
User agent: don't include the patch number in the Firefox version
...
The Firefox version in the user agent doesn't include the patch version: 106.0 not 106.0.2
Close #1914
2022-11-05 22:04:37 +01:00
Alexandre FLAMENT
e92755d358
Initialize Redis in searx/webapp.py
...
settings.yml:
* The default URL was unix:///usr/local/searxng-redis/run/redis.sock?db=0
* The default URL is now "false"
The default URL makes the log difficult to deal with:
if the admin didn't install a Redis instance, the logs record a false error.
It worked before because SearXNG initialized the Redis connection when the limiter started.
In this commit, SearXNG initializes Redis in searx/webapp.py
so various components can use Redis without taking care of the initialization step.
2022-11-05 17:45:52 +01:00
Alexandre Flament
fe419e355b
The checker requires Redis
...
Remove the abstraction in searx.shared.SharedDict.
Implement a basic and dedicated scheduler for the checker using a Redis script.
2022-11-05 12:04:50 +01:00
searxng-bot
7438e48d13
[translations] update from Weblate
...
41ebf8e71de65e6afff11c22f677049febf69b4aa21b6221ac384800c4736fd41b967129
2022-11-04 07:18:35 +00:00
Markus Heiser
fc9986de0a
Merge pull request #1905 from searxng/update_data_update_ahmia_blacklist.py
...
Update searx.data - update_ahmia_blacklist.py
2022-10-29 08:22:43 +02:00
Markus Heiser
3f1d594c23
Merge pull request #1906 from searxng/update_data_update_external_bangs.py
...
Update searx.data - update_external_bangs.py
2022-10-29 08:21:33 +02:00
Markus Heiser
a9deead102
Merge pull request #1907 from searxng/update_data_update_firefox_version.py
...
Update searx.data - update_firefox_version.py
2022-10-29 08:20:53 +02:00
Markus Heiser
d49ccb54ea
Merge pull request #1908 from searxng/update_data_update_wikidata_units.py
...
Update searx.data - update_wikidata_units.py
2022-10-29 08:20:27 +02:00
Markus Heiser
fa59ff9b78
Merge pull request #1909 from searxng/update_data_update_currencies.py
...
Update searx.data - update_currencies.py
2022-10-29 08:19:56 +02:00
dalf
e70589c598
Update searx.data - update_engine_descriptions.py
2022-10-29 01:56:57 +00:00
dalf
985a2a87a6
Update searx.data - update_currencies.py
2022-10-29 01:46:40 +00:00
dalf
c0ecc2f865
Update searx.data - update_wikidata_units.py
2022-10-29 01:46:38 +00:00
dalf
c24abc2f8c
Update searx.data - update_firefox_version.py
2022-10-29 01:46:34 +00:00
dalf
f0c7898445
Update searx.data - update_external_bangs.py
2022-10-29 01:46:27 +00:00
dalf
799c5270ae
Update searx.data - update_ahmia_blacklist.py
2022-10-29 01:46:24 +00:00
Markus Heiser
5a181ea1f5
Merge pull request #1901 from searxng/dependabot/npm_and_yarn/searx/static/themes/simple/master/svgo-3.0.0
...
Bump svgo from 2.8.0 to 3.0.0 in /searx/static/themes/simple
2022-10-28 10:22:56 +02:00
Markus Heiser
d913f0d8aa
[build] /static
2022-10-28 10:17:56 +02:00
searxng-bot
bc3db6fd16
[translations] update from Weblate
...
bf52cdbcfbb36c7618cc8a367314d2b6b25147b9d39ade65cb835cdc563f4e0ba698a2e9df5ce28155b369a33eddf243edd3871d5aab9f7b0b2cfe68732b7865d652c20f0bcaaa8d6fd87821618f213c30d38ee9a934ce3bb696c22e6ee1efe2
2022-10-28 07:18:50 +00:00
dependabot[bot]
3cade9a7eb
Bump svgo from 2.8.0 to 3.0.0 in /searx/static/themes/simple
...
Bumps [svgo](https://github.com/svg/svgo ) from 2.8.0 to 3.0.0.
- [Release notes](https://github.com/svg/svgo/releases )
- [Changelog](https://github.com/svg/svgo/blob/main/CHANGELOG-old.md )
- [Commits](https://github.com/svg/svgo/compare/v2.8.0...v3.0.0 )
---
updated-dependencies:
- dependency-name: svgo
dependency-type: direct:development
update-type: version-update:semver-major
...
Signed-off-by: dependabot[bot] <support@github.com>
2022-10-28 07:13:58 +00:00
searxng-bot
18ba8628dd
[translations] update from Weblate
...
c7fddee3f559a626fe7af6628a7c3da9a84dad5c9ee1ac8bb91bedc4dff99ef4cd639f6c49507a60ad30558219e9707597581f70fcd52cea
2022-10-21 07:32:09 +00:00
Vasilis Gerakaris
947b62c9d5
Fix floating point format in DDG weather humidity
...
Fixes #1836
2022-10-20 11:44:17 +03:00
Alexandre FLAMENT
035bc507ec
[fix] startpage engine
2022-10-14 18:27:53 +00:00
Alexandre Flament
32e8c2cf09
searx.network: add "verify" option to the networks
...
Each network can define a verify option:
* false to disable certificate verification
* a path to existing certificate.
SearXNG uses SSL_CERT_FILE and SSL_CERT_DIR when they are defined
see https://www.python-httpx.org/environment_variables/#ssl_cert_file
2022-10-14 13:59:22 +00:00
searxng-bot
6e86f33342
[translations] update from Weblate
...
eee3d5e2c4eb981827423f5b9e8b7f861203aa6a22c78af56a4776f8c00bdc7de5a39537e3fad460da5f0bc35704a98bf3ef3ebb620636c1767b3bb260d38c87
2022-10-14 07:38:20 +00:00
Markus Heiser
23d797ee6f
Update searx.data - update_osm_keys_tags.py
...
Patch was generated by::
./manage pyenv.cmd searxng_extra/update/update_osm_keys_tags.py
Signed-off-by: Markus Heiser <markus.heiser@darmarit.de>
2022-10-11 11:49:06 +02:00
searxng-bot
325eadfd04
[translations] update from Weblate
...
70909b19acf1f0aa94ce447f59959050e27a5c792c05470f53644516
2022-10-07 07:30:33 +00:00
Mohamed Elashri
8d5653e60d
Merge branch 'searxng:master' into master
2022-09-30 23:06:54 +00:00
searxng-bot
4fea4acea1
[translations] update from Weblate
...
fbac3535cf5d71b76dc351bd42daf1f8f5fb629f4e5f2c795131835f02055902716bd1d7768c8e43e8ad24c1a88c5f91fc70c33a
2022-09-30 07:43:45 +00:00
Alexandre Flament
a7d693231c
Merge pull request #1819 from searxng/update_data_update_currencies.py
...
Update searx.data - update_currencies.py
2022-09-29 16:03:34 +02:00
Alexandre Flament
f3d25f9cef
Merge pull request #1821 from searxng/update_data_update_engine_descriptions.py
...
Update searx.data - update_engine_descriptions.py
2022-09-29 16:02:57 +02:00
Alexandre Flament
5060732486
Merge pull request #1818 from searxng/update_data_update_ahmia_blacklist.py
...
Update searx.data - update_ahmia_blacklist.py
2022-09-29 16:02:02 +02:00
Alexandre Flament
520a873ab4
Merge pull request #1820 from searxng/update_data_update_wikidata_units.py
...
Update searx.data - update_wikidata_units.py
2022-09-29 16:01:31 +02:00
dalf
9cb792c0d6
Update searx.data - update_engine_descriptions.py
2022-09-29 02:22:00 +00:00
dalf
2d429ebd75
Update searx.data - update_wikidata_units.py
2022-09-29 02:13:02 +00:00
dalf
8fc3940448
Update searx.data - update_currencies.py
2022-09-29 02:12:54 +00:00
dalf
b7f4a3a207
Update searx.data - update_ahmia_blacklist.py
2022-09-29 02:12:48 +00:00
dalf
3153f0a795
Update searx.data - update_firefox_version.py
2022-09-29 02:12:48 +00:00
Alexandre Flament
a3148e5115
Merge pull request #1814 from return42/fix-typos
...
[fix] typos / reported by @kianmeng in searx PR-3366
2022-09-28 09:22:02 +02:00
Alexandre Flament
0e00af9c26
Merge pull request #1810 from return42/fix-1809
...
[fix] springer: unsupported operand type(s) for +: 'NoneType' and 'str'
2022-09-28 09:20:03 +02:00
Markus Heiser
ba8959ad7c
[fix] typos / reported by @kianmeng in searx PR-3366
...
[PR-3366] https://github.com/searx/searx/pull/3366
Signed-off-by: Markus Heiser <markus.heiser@darmarit.de>
2022-09-27 18:32:14 +02:00
Mohamed Elashri
212c98c9f5
Merge branch 'searxng:master' into master
2022-09-27 14:03:12 +00:00
Markus Heiser
52023e3d6e
[fix] doc of the paper.html template (isbn, issn)
...
Signed-off-by: Markus Heiser <markus.heiser@darmarit.de>
2022-09-25 15:46:29 +02:00
Markus Heiser
0052887929
[fix] springer: unsupported operand type(s) for +: 'NoneType' and 'str'
...
- fix issue reported #1809
- filter out `None` value from issn and isbn list
- add comments (from publicationName)
- add publisher
Closes: https://github.com/searxng/searxng/issues/1809
Signed-off-by: Markus Heiser <markus.heiser@darmarit.de>
2022-09-25 15:25:55 +02:00
Mohamed Elashri
5832c70680
correct sci-hub links/ add .ru and remove other 3rd party domains.
2022-09-24 11:03:57 -04:00
Markus Heiser
e36b023508
[mod] core.ac.uk: add cetgory 'scientific publications'
...
Signed-off-by: Markus Heiser <markus.heiser@darmarit.de>
2022-09-24 16:16:22 +02:00
Markus Heiser
b424ee255e
[mod] paper.html: simplify template by using result_link macro
...
Signed-off-by: Markus Heiser <markus.heiser@darmarit.de>
2022-09-24 16:13:36 +02:00
Alexandre Flament
bfd6f61849
Merge pull request #1804 from return42/fix-core.ac.uk
...
core.ac.uk: use paper.html template
2022-09-24 15:12:05 +02:00
Alexandre Flament
16443d4f4a
[mod] core.ac.uk: try multiple ways to get url
...
If the url is not found, using:
* the DOI
* the downloadUrl
* the ARK id
2022-09-24 15:02:39 +02:00
Markus Heiser
3198c906af
[mod] paper.html: add links to doi resolver
...
Signed-off-by: Markus Heiser <markus.heiser@darmarit.de>
2022-09-24 14:19:51 +02:00
Markus Heiser
c76830d8a8
[mod] core.ac.uk: use paper.html template
...
Signed-off-by: Markus Heiser <markus.heiser@darmarit.de>
2022-09-24 13:19:33 +02:00
Markus Heiser
3ff2ad939d
[fix] ERROR searx.engines.core.ac.uk: list index out of range
...
Some result items from core.ac.uk do not have an URL::
Traceback (most recent call last):
File "searx/search/processors/online.py", line 154, in search
search_results = self._search_basic(query, params)
File "searx/search/processors/online.py", line 142, in _search_basic
return self.engine.response(response)
File "SearXNG/searx/engines/core.py", line 73, in response
'url': source['urls'][0].replace('http://', 'https://', 1),
Signed-off-by: Markus Heiser <markus.heiser@darmarit.de>
2022-09-24 13:19:33 +02:00
Markus Heiser
caebafdd06
[fix] typo in crossref settings: disable --> disabled
...
Signed-off-by: Markus Heiser <markus.heiser@darmarit.de>
2022-09-24 08:12:36 +02:00
Alexandre Flament
d6446be38f
[mod] science category: various update of about PR 1705
2022-09-23 20:52:55 +02:00
Alexandre FLAMENT
fe43b6e821
[build] /static
2022-09-23 20:45:58 +02:00
Alexandre FLAMENT
e36f85b836
Science category: update the engines
...
* use the paper.html template
* fetch more data from the engines
* add crossref.py
2022-09-23 20:45:58 +02:00
Alexandre FLAMENT
593026ad9c
oa_doi_rewrite: add the doi to the result when it is found.
...
Currentty, when oa_doi_rewrite find a DOI in the result URL, it replace the URL.
In this commit, the plugin adds the key "doi" to the result,
so the paper.html can show it.
2022-09-23 20:45:58 +02:00
Alexandre FLAMENT
5ba831d6a8
Add paper.html result template
2022-09-23 20:45:58 +02:00
Alexandre FLAMENT
a96f503d7b
Add searx.webutils.searxng_format_date
...
* Move the datetime to str code from searx.webapp.search to searx.webutils.searxng_format_date
* When the month, day, hour, day and second are zero, the function returns only the year.
2022-09-23 20:45:58 +02:00
Alexandre Flament
bef3984d03
Merge pull request #1728 from liimee/eng-ddw
...
add duckduckgo weather engine
2022-09-23 18:14:09 +02:00
Alexandre Flament
d3fec1388c
Merge pull request #1624 from liimee/eng-wttr
...
Add wttr.in engine
2022-09-23 18:13:37 +02:00
searxng-bot
ab6e1542ff
[translations] update from Weblate
...
55133802b9309bdf6da8db13c1edbd899795e5fe
2022-09-23 07:38:23 +00:00
Alexandre Flament
1a7b6872b5
Merge pull request #1792 from unixfox/google-images-internal-api
...
use the internal API for google images
2022-09-21 19:50:38 +02:00
Markus Heiser
cf7ee67f71
[mod] google-images: slightly improvements of the engine
...
Signed-off-by: Markus Heiser <markus.heiser@darmarit.de>
2022-09-21 18:59:55 +02:00
Markus Heiser
8b40e68c56
[fix] wording: SearXNG is 'open' and not 'hackable'
...
The word "hackable" may arouse interest in programmers to participate in the
development, but it scares the ordinary user.
Signed-off-by: Markus Heiser <markus.heiser@darmarit.de>
2022-09-21 17:10:35 +02:00
Emilien Devos
df5f8d0e8e
use the internal API for google images
2022-09-20 22:52:38 +02:00
Markus Heiser
dcf1d408a5
[fix] google-news: origin result does not have a content area
...
The google news are in a rework, the content area of a news item has been
removed.
Closes: https://github.com/searxng/searxng/issues/1790
Signed-off-by: Markus Heiser <markus.heiser@darmarit.de>
2022-09-20 20:18:43 +02:00
