retoor/searxng
1
0
Fork 0
Code Issues Pull Requests Actions Packages Projects Releases Wiki Activity
1,390 Commits 6 Branches 17 Tags
bb8b9901239d2bffe8df6c8ffd42e698fa62bea5
Commit Graph
96 Commits
This Branch
This Branch
All Branches
Author SHA1 Message Date
Dalf 21332a3e52 update dependency versions described by versions.cfg 2015-06-26 17:44:51 +02:00
Alexandre Flament 1b77befe1f Merge pull request #367 from glogiotatidis/dockerfileupdate 
Update Dockerfile.
 2015-06-10 19:09:57 +02:00
Dalf ded3f98218 www1x engine: remove comment about unavailable https (https is working now) 2015-06-06 19:44:41 +02:00
Dalf 9e147d91f0 bing_images & www1x engines use https connections 2015-06-06 19:23:07 +02:00
Dalf fc0ae0f907 google engine: code cleanup 2015-06-06 00:18:00 +02:00
Dalf 72c8de35a2 google engine :remove OSM map 2015-06-05 23:56:23 +02:00
Alexandre Flament b8fc531b60 [enh] google engine : parse map links and more 2015-06-05 11:23:24 +02:00
Dalf dafedbfc55 youtube_noapi uses searx.utils.list_get 2015-06-04 18:34:44 +02:00
Dalf 62cc2a5658 [fix] bing_news based on RSS output format 2015-06-04 18:30:08 +02:00
Dalf 4e0f079a8c [fix] youtube_noapi : don't crash when there is no content 2015-06-03 10:12:30 +02:00
Dalf 9d10277c22 remove 'print' 2015-06-02 10:50:49 +02:00
Alexandre Flament fb4df9d6c3 Merge pull request #349 from Cqoicebordel/startpage_autocomplete 
Add startpage as an autocompleter engine
 2015-06-02 10:43:10 +02:00
Alexandre Flament 39ff21237c [enh] google engine : avoid some "sorry google" by adding another cookie : NID. This cookie is specific by hostname. 
This allow to send request to google.* (according to the search language).
Before this commit, request in other languages than english was sent to www.google.com which was redirected to www.google.*
The PREF is still use on the www.google.com domain.
 2015-05-30 17:41:40 +02:00
Alexandre Flament 484d0974f7 startpage and ixquick enignes : disabled by default, and timeout set to 6 seconds. 2015-05-30 13:36:10 +02:00
Alexandre Flament 6765823c56 [fix] set engine.safesearch to False if not defined 2015-05-30 12:37:18 +02:00
Alexandre Flament d4d2dd9cb3 [enh] oscar theme: display engine response times in the preferences 2015-05-30 12:15:23 +02:00
Alexandre Flament 7afd02c94e [fix] flickr engine 2015-05-27 13:49:25 +02:00
Alexandre Flament 3d70921175 [fix] bing_news 2015-05-27 12:08:50 +02:00
Alexandre Flament 5525625dae [enh] currency_convert engine: user can write "1 dollars in euros" instead of "1 USD in EUR". 
The currency names are fetched wikidata and store into a static file : searx/data/currencies.json
This file is loaded when the currency_converter is loaded.
A database is perhaps more appropiated.
 2015-05-12 20:52:08 +02:00
Alexandre Flament 44ed4424f6 [fix] yahoo_news engine 2015-05-03 13:41:36 +02:00
Alexandre Flament 48cffb141b [fix] twitter engine 2015-05-02 18:20:12 +02:00
Alexandre Flament 4689fe341c update versions.cfg to use the current up-to-date packages 2015-05-02 15:45:17 +02:00
Alexandre Flament 59ee040424 [fix] remove a useless print 2015-05-02 15:28:08 +02:00
Alexandre Flament 65e6737413 [fix] google engine tests 2015-05-02 13:21:01 +02:00
Alexandre Flament 732ed952dc [fix] 1x.com tests 2015-05-02 13:09:18 +02:00
Alexandre Flament e7fd546aae [fix] revert of 1x.com (no valid https certificate) 2015-05-02 13:02:42 +02:00
Alexandre Flament 6cd9a045f8 [fix] flickr engine 2015-05-02 12:36:49 +02:00
Alexandre Flament f5d3b21566 [fix] user agent : the "rv:{version}" was missing (can be a issue with some engine, like flickr) 2015-05-02 12:35:57 +02:00
Alexandre Flament 78edc16e66 [enh] reduce the number of http outgoing connections. 
engines that still use http : gigablast, bing image for thumbnails, 1x and dbpedia autocompleter
 2015-05-02 11:43:12 +02:00
Alexandre Flament 8a69ade875 Revert of #195 when the search language is not english 
Sometimes there is two requests to google (depending of the source IP) : one to google.com, the second to google.fr (for instance).

Going to https://www.google.com/ncr and saving the PREF cookie for future use prevent this (there is no redirection).

But, recently (or not ?), by doing this the search returns English results even if the Accept-Language is specified.

There is still a way to prevent this : going to preference, set the search language. I don't know if this can be done by searx.

For now, a quick fix is to disable the use of the PREF cookie when the search language is not English (google engine will slower but returns excepted results).
 2015-05-01 21:20:09 +02:00
Alexandre Flament 043b269c6e [fix] tests 2015-04-26 19:23:06 +02:00
Alexandre Flament 8806002886 Merge remote-tracking branch 'origin/ssl' into https 2015-04-26 19:12:17 +02:00
Alexandre Flament 187617498a Log an error if the ndg-httpsclient, pyopenssl and pyasn1 packages are not installed. 
See #298
 2015-04-26 18:58:31 +02:00
Alexandre Flament 99efd790c8 engines: use https when possible 2015-04-26 18:13:09 +02:00
Alexandre Flament 47b011829d settings.yml clean up : remove locale 
locale was declared for bing* engines and vimeo.

  * bing* engines use the language settings.
  * vimeo uses neither locale nor language settings.

This avoid confusion
 2015-04-26 17:35:31 +02:00
Alexandre Flament ada5993f61 [fix] #264 : implementation using Referrer Policy (Editor’s Draft, 3 March 2015) 
see http://w3c.github.io/webappsec/specs/referrer-policy/
 2015-04-26 15:48:48 +02:00
Alexandre Flament 77b2fbb61e [enh] implements #264 : add rel="noreferrer" to external links 2015-04-26 15:32:26 +02:00
Alexandre Flament 2be52b74ad [fix] tests 2015-04-26 12:34:09 +02:00
Alexandre Flament 201928d2b0 [fix] SSL : SNI support 2015-04-26 12:04:29 +02:00
Alexandre Flament 83e48fa89b flake8 fix 2015-04-25 12:05:35 +02:00
Alexandre Flament cde37be4f5 [enh] basic support for http proxy (see #236) 2015-04-25 11:44:53 +02:00
dalf 7cc5146c14 [fix] btdigg: disable ssl check, 
avoid this error : SSLError: hostname 'btdigg.org' doesn't match either of 'ssl2000.cloudflare.com', 'cloudflare.com', '*.cloudflare.com'
 2015-02-20 22:56:04 +01:00
dalf 57996b12fc [fix] update yahoo engine according to the web site changes 2015-02-20 12:34:13 +01:00
dalf 5029cb4787 [fix] close #197 for all engines 2015-02-13 11:17:00 +01:00
dalf 9d537c0bad [fix] kickass tests 2015-02-12 14:50:41 +01:00
dalf c4dd7c3a54 Merge branch 'master' of https://github.com/dalf/searx 2015-02-12 14:33:28 +01:00
dalf 9db0bbc304 [fix] kickass engine : change the hostname to kickass.to (since kickass.so doesn't respond). 
Close #197 perhaps not in clean way. Explanation :
In fact 301 responses are followed, except the hook is called for each HTTP response,
the first time for the HTTP 301 response then for HTTP 200 response.
Since the kickass engine excepts a real result, the engine crashes, AND the requests lib stops here.
Add a simple test at the beginning of the result function allows pass the first response and handle correctly the second response (the real one)

May be a proper way is to add this test in search.py ?

Code inside requests :
https://github.com/kennethreitz/requests/blob/53d02381e22436b6d0757eb305eb1a960f82d361/requests/sessions.py#L579
and line 591
 2015-02-12 14:30:03 +01:00
dalf 1cf870c024 [fix] kickass engine : change the hostname to kickass.to (since kickass.so doesn't respond). 
Close #197 perhaps not in clean way. Explaination :
In fact 301 responses are followed, except the hook is called for each HTTP response,
the first time for the HTTP 301 response then for HTTP 200 response.
Since the kickass engine excepts a real result, the engine crashes, AND the requests lib stops here.
Add a simple test at the begining of the result function allows pass the first response and handle correctly the second response (the real one)

May be a proper way is to add this test in search.py ?

Code inside requests :
https://github.com/kennethreitz/requests/blob/53d02381e22436b6d0757eb305eb1a960f82d361/requests/sessions.py#L579
and line 591
 2015-02-12 12:30:03 +01:00
dalf 0a83be0ec9 [fix] google engine: depending on the IP of the searx instance, each searx request where making two HTTP requests (see https://support.google.com/websearch/answer/873?hl=en ) 2015-01-22 11:40:28 +01:00
dalf d07cfd9089 [enh] use one single http connection pool : improve response time. close #100 2015-01-21 11:33:16 +01:00
dalf 1d51512152 Proxify most of images references 
Create hash only when necessary
 2015-01-18 09:54:24 +01:00
dalf 9154cf7930 Proxify images inside infoboxes 2015-01-17 22:36:48 +01:00
dalf b6d27aca59 [enh] image-proxy : handle ETag and date related headers, add hash to URL 2015-01-17 21:54:40 +01:00
dalf 7c13d630e4 [fix] pep8 : engines (errors E121, E127, E128 and E501 still exist) 2014-12-07 16:37:56 +01:00
dalf ffcec383b7 [fix] pep8 : duckduckgo_definitions and wikidata engines 2014-12-07 16:36:20 +01:00
dalf 8534d8b87a [fix] test : the icon is included inside the <h3> element 2014-10-26 12:01:54 +01:00
dalf a71b326d9e [mod] default template modifications 
- more smartphone friendly
- more text browser friendly
- next button always on the right
- in case of small screen supporting touch event, categories are displayed on one line with a scroll
 2014-10-26 11:14:05 +01:00
dalf be4d219ae7 [mod] use pngcrush to reduce the size of png files 2014-10-25 17:07:39 +02:00
dalf 400279182e [fix] no horizontal scrolling on small screen 
[fix] small images in the results aren't not "zoomed"
 2014-10-25 17:05:37 +02:00
dalf cac1761a54 [enh] infoboxes : if the result doesn't contain anything except one link, use the normal result template 2014-10-11 15:49:50 +02:00
dalf 295b1699ce [mod] return only one result from the wikidata engine 2014-10-11 12:47:30 +02:00
dalf 599c1137bb [fix] the bang was included in the search string 2014-10-11 12:46:12 +02:00
dalf 63a0328c8b [enh] wikidata engine : add links to musicbrainz 2014-10-02 23:40:06 +02:00
dalf 728fc611da [fix] infoboxes and answers : pass all tests 2014-10-01 22:46:31 +02:00
dalf 829c758970 Merge remote-tracking branch 'upstream/master' 2014-10-01 22:25:11 +02:00
Dalf 0a71525ab6 [enh] add infoboxes and answers (clean up) 2014-10-01 22:17:35 +02:00
Dalf 6bfd566353 [enh] add infoboxes and answers 2014-09-28 16:51:41 +02:00
Dalf e39d9fe542 update comment 2014-09-22 23:39:21 +02:00
Dalf 6b058962e1 [fix] when two results are merged, really use the content with more text 2014-09-22 22:55:51 +02:00
Dalf 5dc3eb3399 [fix] rewrite the google engine since Google Web Search API is about to expire 2014-09-14 14:40:55 +02:00
Dalf 5d1610d87a [enh] stick results from the same category and template 2014-09-14 14:39:22 +02:00
dalf 64b75e6d82 [enh] duckduckgo engine: add language support 2014-09-07 22:52:13 +02:00
Dalf a4ffeddce1 [fix] yahoo engines: parse_url doesn't throw an exception with not tracking URL 2014-09-07 18:42:56 +02:00
Dalf a92e3ba446 [fix] bing_new engine : fix published date parsing 2014-09-07 18:10:05 +02:00
Dalf 7f1e2ba211 [enh] dailymotion engine: add language support 2014-09-07 17:14:42 +02:00
Alexandre Flament 16e92b8d77 [doc] link to the installation steps. 2014-01-12 11:42:20 +01:00
Dalf 8433421156 [mod] more web page modification 2014-01-07 00:21:08 +01:00
Dalf 289a5707ed Merge remote-tracking branch 'upstream/master' 2014-01-06 18:53:41 +01:00
Dalf dfce4fd865 [fix] add preference-icon.png 2014-01-05 20:32:09 +01:00
Dalf 7915b5c5a0 [mod] web page modification 2014-01-05 20:27:13 +01:00
Dalf 3dc3fc7770 [mod][fix] xpath engine simplified, yahoo engine never returns truncated urls 2014-01-05 14:06:52 +01:00
Dalf a2928e8d83 [fix] startpage engine : characters with diacritic were preceded by whitespace, and cleaner way to parse the result. 2014-01-05 14:00:10 +01:00
Dalf bf56ec4fb1 [mod] bing and duckduckgo engines : add / rename locale parameter 2014-01-05 13:58:17 +01:00
Dalf 49c85fce51 [fix] dailymotion engine : no more html tag in the description 2014-01-05 13:55:17 +01:00
Dalf e88cf0a0a8 [mod] minor fixes (duckduck_definitions : if a ddg bang is in the query, avoid a useless redirect) 2014-01-05 13:50:17 +01:00
Dalf 75d22cd847 [mod] no glitch on small screen like smartphone 2014-01-04 00:27:40 +01:00
dalf b70b0775f3 [mod] the search text input gets the focus automatically only on the index page. 2014-01-02 23:02:38 +01:00
dalf 43a6ffcd46 [fix] the search text input gets the focus automatically 2014-01-02 22:57:28 +01:00
dalf 2006a1df1c Merge branch 'master' of github.com:dalf/searx 2013-12-31 13:36:16 +01:00
dalf 4e8b75a0fb [mod] the search text input gets the focus automatically 2013-12-31 13:35:43 +01:00
dalf 6d5154f008 [mod] the search text input gets the focus automatically 2013-12-31 13:33:45 +01:00
dalf 04727a2043 [mod] more html5 compliant 2013-12-31 12:58:10 +01:00
dalf 4009b9a66d [mod] the browser search always uses the general category 2013-12-31 12:54:48 +01:00
dalf d3e272d035 add dailymotion engine 2013-12-30 22:42:37 +01:00
dalf 664c039b38 xpath engine: bug fix 2013-12-30 22:34:35 +01:00
dalf 9eddcdb8e4 flickr engine: bug fix 2013-12-30 22:24:42 +01:00