Jsoup connect（）：绕过谷歌validation码

我做了一个小应用程序，我必须根据关键字检索URL。 这是代码：

Elements doc = Jsoup .connect(request) .userAgent( "Mozilla 5.0 (Windows NT 6.1)") .timeout(5000).get().select("li.g>h3>a"); for (Element link : doc) { String url = link.absUrl("href"); try { url = URLDecoder.decode(url.substring(url.indexOf('=') + 1, url.indexOf('&')), "UTF-8"); } catch (UnsupportedEncodingException e) { // TODO Auto-generated catch block e.printStackTrace(); } if(!url.startsWith("http")) continue; // Ads/news/etc. else if(url.contains("/pdf/")) continue; else if(url.contains("//github.com/")) continue; res.add(url); } 

只是得到以下错误：

 org.jsoup.HttpStatusException: HTTP error fetching URL. Status=503, URL=http://ipv4.google.com/sorry/IndexRedirect?continue=http://www.google.com/search%3Flr%3Dlang_en.... at org.jsoup.helper.HttpConnection$Response.execute(HttpConnection.java:435) at org.jsoup.helper.HttpConnection$Response.execute(HttpConnection.java:446) at org.jsoup.helper.HttpConnection$Response.execute(HttpConnection.java:410) at org.jsoup.helper.HttpConnection.execute(HttpConnection.java:164) at org.jsoup.helper.HttpConnection.get(HttpConnection.java:153) at sperimentazioni.Main.getDataFromGoogle(Main.java:327) at sperimentazioni.Main.getURLs(Main.java:164) at sperimentazioni.Main.main(Main.java:485) 

显然它是validation码谷歌，我怎么能绕过？

Answer 1

您无法绕过它，但是您可以使用第三方服务进行CPATCHA识别并发布正确答案。 检查DeatchByCaptcha.com

Answer 2

以下逻辑对我有用：

 Document doc = Jsoup.connect(request) .userAgent("Mozilla/5.0 (compatible; Googlebot/2.1; +http://www.google.com/bot.html)") .timeout(5000).get(); Elements links = doc.select("a[href]"); for (Element link : links) { String temp = link.attr("href"); if (temp.startsWith("/url?q=")) result.add(temp); } 

Answer 3

解决此问题的唯一方法是将captcha显示给用户，然后从响应头中保存cookie。