How To Handle Captcha In Selenium 🤷| Selenium 4 Tutorial With Java | LambdaTest

Aug 15, 2023

How To Handle Captcha In Selenium 🤷| Selenium 4 Tutorial With Java | LambdaTest

Captcha has always been tricky for testers to automate since many are unfamiliar with handling Captchas using Selenium. Watch this video to learn how to handle Captcha using Selenium with Java. Start FREE Testing: https://accounts.lambdatest.com/?utm_…

📢 In this Selenium 4 Java Tutorial, 𝑨𝒏𝒕𝒐𝒏 𝑨𝒏𝒈𝒆𝒍𝒐𝒗 (@𝒂𝒏𝒈𝒆𝒍𝒐𝒗𝒔𝒕𝒂𝒏𝒕𝒐𝒏), Co-founder \u0026 CTO of Automate The Planet Ltd., explains what is Captcha and how to automate image Captcha in Selenium WebDriver. He also discusses ReCaptcha, which is hosted by Google and protects your site from spam and abuse.

🔹 𝑾𝒉𝒂𝒕 𝒊𝒔 𝑪𝒂𝒑𝒕𝒄𝒉𝒂?
➡ CAPTCHA stands for “Completely Automated Public Turing Test to Tell Computers and Humans Apart.” It is a “challenge-response” test used to determine if the user is a human or a bot.

🔹 𝑾𝒉𝒂𝒕 𝒂𝒓𝒆 𝒕𝒉𝒆 𝒘𝒂𝒚𝒔 𝒕𝒐 𝒉𝒂𝒏𝒅𝒍𝒆 𝑪𝒂𝒑𝒕𝒄𝒉𝒂 𝒊𝒏 𝑺𝒆𝒍𝒆𝒏𝒊𝒖𝒎?
➡ By disabling Captchas in test environments.
➡ By clicking the reCAPTCHA checkbox in Selenium.
➡ By adding a delay in your Selenium script and manually solving Captcha while running.

🔹 𝑾𝒉𝒂𝒕 𝒊𝒔 𝒓𝒆𝑪𝑨𝑷𝑻𝑪𝑯𝑨?
➡ reCAPTCHA is a CAPTCHA system that lets web hosts tell the difference between real people and automated programs that try to access their sites. Google’s reCAPTCHA is a free service used by many people because it works with most screen readers.

📌Also, you will learn📃
📍 Can we handle CAPTCHA in Selenium?
📍 Can we test CAPTCHA and barcode using Selenium?
📍 How do I capture CAPTCHA using automation Anywhere?
📍 Can we automate CAPTCHA using API?

Ｖɪᴅᴇᴏ Ｃʜᴀᴘᴛᴇʀꜱ 👀
0:00 Introduction
0:22 Modules
2:30 What is a Captcha?
4:36 Captcha test cases
8:15 Handling Captchas in Selenium with demo
19:57 Handling audio captchas in Selenium with cognitive services
27:50 Conclusion

📌 𝑮𝒊𝒕𝑯𝒖𝒃 𝑳𝒊𝒏𝒌: https://github.com/AutomateThePlanet/…

𝑹𝒆𝒍𝒂𝒕𝒆𝒅 𝑷𝒍𝒂𝒚𝒍𝒊𝒔𝒕𝒔
▶ Selenium Testing Tutorial: https://bit.ly/3tblD5a
▶ Selenium 4 New Features and Enhancements | Beginners Guide: https://bit.ly/34JzdDF
▶ JavaScript Selenium Testing Tutorial For Beginners: https://bit.ly/3B00NKw

𝑹𝒆𝒍𝒂𝒕𝒆𝒅 𝑩𝒍𝒐𝒈𝒔
➡ How To Handle Captcha In Selenium: https://bit.ly/3fzvRVw
➡ Selenium Java Tutorial: Automation Testing Of User Signup Form: https://bit.ly/3PklUeM
➡ A Detailed Guide On Selenium With Java [Tutorial]: https://bit.ly/3zjOzes
➡ Selenium Automation Testing: Basics and Getting Started: https://bit.ly/3aYJgHQ
➡ Selenium Grid 4 Tutorial For Distributed Testing: https://bit.ly/3Ogo4L3
➡ Complete Selenium WebDriver Tutorial with Examples: https://bit.ly/3GHm0c0
➡ What Is New In Selenium 4 And What Is Deprecated In It?: https://bit.ly/3q8OvsU
➡ How To Build And Execute Selenium Projects: https://bit.ly/3GFLlmS

𝑳𝒆𝒂𝒓𝒏𝒊𝒏𝒈 𝑯𝒖𝒃
🚩 Detailed Selenium 4 Tutorial: https://bit.ly/3mC5m6f
🚩 Selenium Java Tutorial: https://bit.ly/3IOSd3c

Sign Up for LambdaTest! It’s FREE 🙌
Perform scalable and reliable cross-browser compatibility testing of your website and web app on the latest mobile and desktop browsers: https://accounts.lambdatest.com/?utm_…

Register Now to Avail Bonanza Offerings 💎
+ Test websites and web apps on 3000+ real browsers over LambdaTest cloud
+ Trusted By 1M+ users, 500+ enterprises and 130+ countries
+ Online scalable Selenium Grid to perform Manual as well as Automation Testing
+ 100 minutes of free Web + Mobile Automation Testing
+ 60 minutes of free Live Interactive Testing per month
+ 10 Screenshot Tests per month
+ 10 Responsive Tests per month (Test a page across 50+ Device configurations with a single click)
+ Unlimited free testing on LT Browser

For questions: [email protected] 😃

𝑬𝒙𝒑𝒍𝒐𝒓𝒆
🎬 Most Recent Videos: https://bit.ly/3kUUeAQ
🎓 Learning Hub: https://bit.ly/3fr6l4Z
🎥 LambdaTest Customers: https://bit.ly/2TB7pvD
🚀 Webinars: https://bit.ly/37i41co
🛠️ Product Updates: https://bit.ly/3717NGO
💬 LambdaTest Certifications: https://bit.ly/3x4EtcY

𝑺𝒐𝒄𝒊𝒂𝒍
📝 BLOG: https://bit.ly/3yGVsUc
👥 COMMUNITY: https://bit.ly/3Aiz5oO
🔴 NEWSLETTER: https://bit.ly/3juhxzc
🖼️ GITHUB: https://bit.ly/3jowfYs
🛠️ YOUTUBE: https://bit.ly/3rH2Yfh
🌎 LINKEDIN: https://bit.ly/3xA6F84
👥 FACEBOOK: https://bit.ly/37mbQOa
🐦TWITTER: https://bit.ly/3Cn0g3A
📸 PINTEREST: https://bit.ly/2VCXI05

#selenium4tutorial #javatutorial #captchaautomation #lambdatest #captchaselenium
#seleniumwithjava #selenium4 #selenium4java #seleniumguide #java #selenium

Disclaimer:
This video features materials protected by the Fair Use guidelines of Section 107 of the Copyright Act. All rights reserved to © 2022 LambdaTest. Any illegal reproduction of this content will result in immediate legal action.

Content

4.64 -> hi guys greetings from bulgaria it's in the middle of summer so here it's really hot

10.64 -> anyway i'm here for yet another video from our selenium course let me share my screen

20.88 -> so i'm antonio and in our new course about selenium

28.96 -> in the first video we talked about sign up forms uh it's a long video but really

34.48 -> essential especially for junior people because uh sign up forms are stuff that

40.56 -> we often ask about tasting such scenarios during interviews so check it out it's really important

50.56 -> then as a continuation to that uh in the second video it was really interesting we walked into

57.68 -> third-party services that can help us to automate the receiving of emails interacting with them even

64.56 -> responsive testing them in the cloud and now in the third video we are going to talk about

70.4 -> handling captchas captures we're going to talk about what they are

74.48 -> and uh how to test them and how to interact with them in our automated tests then we are going to

81.28 -> talk about cookies in order to speed up our test execution and they can help us a lot

86.72 -> this will happen in the next video and in the rest of the videos we are going to talk about

93.12 -> how to optimize the speed of your test with weights in different design patterns

97.92 -> handling some selenium exceptions and improving the maintainability with event listeners if you

104.72 -> haven't subscribed to the lambdatest video channel do so hit the ring bell and get notified each

113.84 -> week many new videos are uploaded and they are pretty useful on different technologies and then

124.32 -> yeah check the description below you will find all the source code that we

127.92 -> are going to talk about its github and will add their many useful resources

135.12 -> and of course in each video we are going to discuss not only how to make this work

139.84 -> only on your machine but how to run this in scale in the cloud because in many enterprise

146.8 -> projects actually this is how we execute the tests in lambda test or another blackboard

154 -> and now handling captures but before that let's first discuss uh what are the captchas and i

162.16 -> added here a few images uh what is kept capture stands for wait for it completely ultimate public

170.8 -> turing test to tell computers and humans apart i know it's one this is why we call them capture

177.12 -> in short and this is basically a type of challenge response test used to ascertain

183.12 -> whether the user is human or a bot the primary purpose of captcha is to prevent both

191.44 -> or automated programs from using various types of computing services or collecting certain types of

198.08 -> sensitive information such as emails phone numbers etc uh there are various forms

206.64 -> here there are others that are much more complicated that you need to do some kind

211.12 -> of a weird mathematic uh solve mathematic formula and then um yeah they're really hard catches right

224.16 -> and uh so um to the bottom right you will see uh uh an image generated by your capture

233.68 -> and in a minute we're going to talk much more about it because this is basically

238.4 -> the capture image capture widgets that it's free to use from google and capture are mostly

246.88 -> dynamic and are intended to defeat automation frameworks like selenium however since they are

253.6 -> dynamic they can be carried out successfully only with or only with human interaction and analysis

260.96 -> and as a result most of the automation bots will fail however it's really important since

266.88 -> they are essential parts of our modern web pages to test them before even automating them

275.2 -> and what we can test about first you need to verify that the application accepts only valid

281.52 -> catch right then you need to verify that the code uh the captcha code is case sensitive you need to

291.28 -> verify that the error message is displayed if a user enters an incorrect captcha code

297.92 -> then you need to verify that the captcha code to the screen is properly visible to the user or not

304.8 -> then you need to verify that new captcha is getting generated on batch refresh or

312.24 -> some captures they have this refresh button you need to verify that new captcha is generated if

319.92 -> a user enters some incorrect captcha code you need to verify that the copy

325.36 -> paste action doesn't work on capture input boxes this is like a security precaution

332.56 -> and you need to verify that the application is not accepting partial capture code and from my

339.12 -> personal experience uh you need to check if your website probably is using some kind of a cdn

350.72 -> service for optimizing the speed of websites you need to check if the images are coming from there

357.36 -> that it's working properly or if you are using some kind of a service for speed optimization

364.56 -> sometimes some of the scripts are merged or delayed etc so you need to be careful about that

371.44 -> because some of these optimizations they are turned off for the test environments because some

379.04 -> some of the services they're actually paid many of them based on the world

387.52 -> another thing that you need to consider especially for big websites enterprise websites

392.88 -> is that many of them our websites are hosted on more than one server or the so-called server note

401.2 -> and they're behind the world balancer this is like a service that is balancing the requests uh

408.56 -> based on the uh the vote on these different notes and this means that you're not sure when

417.84 -> you send a request on which note you will be uh balanced right uh usually this is just a single

426.32 -> note however in practice it's possible one request to go to uh not one and then the second to not two

432.72 -> and actually this happens to me uh and we catch a really weird look uh especially for catches

440.64 -> uh also um you need as you can see from from the right uh there is this audio version that it's

448.24 -> like a accessibility feature uh that you need to check like an alternative to the capture you

454.96 -> hear something you need to type the text and then bypass the captcha and actually

460.08 -> as you'll see in the end of the module we are going to use this option to automate

464.96 -> some of the pages and of course you need to check that this is working on different browser versions

471.76 -> operating systems etc or mobile so definitely platform such as land this can help here

480.56 -> so what are the what are the different ways to handle captchas in selenium the easiest and most

488.4 -> foolproof way to handle captures in selenium is to disable the need for captures during your test

494.24 -> by disabling captures in test environments you would no longer need uh to perform captures

500.88 -> tasks while testing a web application and actually this was something that we did for

504.96 -> one of our enterprise projects that my company is involved we we talked with developers and they

512.8 -> for the test environment they added a special cookie that when we add the cookie we're just

519.36 -> dissembling the captcha this way on the test environment we we have the full flexibility to

525.68 -> um turn on the capture test it and then turn it off for some of the automated tests which is ideal

533.2 -> um however this requires like cooperation from the development

538.56 -> this is not always possible and also you need to be careful with this type of conditions in

543.84 -> the code because you need to make sure that this is not available on production right

552.32 -> because someone might may exploit it

555.76 -> and the another disadvantage of this approach is that you are testing something different

560.72 -> from your production environment ideally you want your automated

565.28 -> tests to test your product in an environment that resembles your production environment and

574.4 -> now disabling captchas actually has become very easy with google's open source capture widget

580.24 -> called recaptcha this is uh actually this here probably this is version two uh you saw it in many

588.08 -> places where you you click at this checkbox and this is actually a capture version too

594.16 -> uh so what is recaptcha capture is a capture system that enables web host to distinguish

599.36 -> between human and automated access to websites it's a free service from google and it's very

605.92 -> widely used nowadays since it supports all major browsers and operating systems

612.4 -> version 2 you can put a side key and secret key also known as test keys in this case will help

621.76 -> bypass the capture verification requests as a result your automation test can run seamlessly

630.72 -> once you enable the site keys you will see a warning is here as shown below this indicates that

638.72 -> the capture has been bypassed only for testing purposes not in real time uh and let me show you

647.36 -> here for this demo website that i created this is just the contact form uh we are going to

653.76 -> automate it in a minute uh it just accepts first name was name email we have other options here

661.44 -> and then in the bottom we have capture version two and capture version two it here marks that it's

668.64 -> protected by recaptcha this is their website as i name it capture video here i use version three

678.64 -> here i can see my keys you just add them to your for wordpress for example there are some plugins

684.32 -> that directly you just put the two keys and it's added automatically to the contact form or you can

691.04 -> add it as html snippet it's fine so yeah basically instead of generating here the keys you just put

701.36 -> the disk is uh actually these are the test keys here uh from where you can gain them

708.16 -> because you know um no matter which extra widgets you are going to use

715.28 -> your best friend is actually their development documentation you can check it out

720.64 -> many of these capture services they have a version for testing depending on how they are integrated

728.88 -> whether this is javascript or something else and you can turn them off uh and again here

736.8 -> on their website they have this i would like to run automatic tests

741.12 -> with their capture what should i do and then you get these two hardcoded

746.72 -> keys and you put them in your test environment and then this will work

752.64 -> this is one of the ways how you can do it however this is version 2. uh actually they have

760.16 -> a capture version 3 which is sometimes referred to as invisible capture actually it doesn't have this

767.28 -> checkbox and uh capture version 3 actually verify request with a score it allows you to verify

775.6 -> even interaction is legitimate without any user interaction it is a pure javascript api

782.4 -> returning a score and this gives your developers the ability to take action in the context of your

789.92 -> website for instance requiring additional vectors authentication sending a post for moderation

796.96 -> or throttling bots that may be scrapping condense how you can handle invisible capture

806.16 -> you know unfortunately the invisible captures they try to block the web traffic that appears

811.36 -> to come from a bot it detects as you know when when we started this in selenium they appear

817.76 -> here that they are controlled by automated test software so this invisible capture

822.48 -> detects that uh and it will uh basically block off the web traffic so one way to handle that

830.88 -> is if we set a different user agent the user agent is used in http to control

841.36 -> basically instruct the server from which type of web clients we are asking the web resources

850.24 -> so we can change them they are websites that you can find many different user agents

855.2 -> this is the first thing and then the second thing is that you need to um

863.28 -> basically uh another way these invisible captures uh are detecting that you are not a human if you

870.88 -> use um not recommended non-conventional viewports and this is why another way is just always to

879.76 -> start maximize the web browser and use proper resolution if you are using a cloud platform

886.56 -> these are the two ways how you can battle the invisible captchas

890.4 -> usually uh in some of the enterprise projects that i have been involved

895.52 -> we use some kind of a combination between version 2 and version 3 is a fallback

901.92 -> so what we do here uh to automate this captcha another thing you need to consider when when we

909.28 -> are dealing with such captures is that uh if you want to check this box uh we need to make sure to

919.44 -> check it in a timely manner and simulate that you are not a bolt you don't want to

924.48 -> check it too fast otherwise it will detect that uh you are not a human so uh one way to do that

935.36 -> is we are going to use webdriverweight and we will wait until this checkbox is clickable

942.16 -> again in a different module from the course we're going to talk about trade slips weightings etc

948.72 -> anyhow before that we're going to talk about how we can wait for that another thing if you find

957.2 -> this div here and if you want to check it you will notice that this just don't work right for example

966.96 -> here is my test again we find we navigate to the website uh we find the different

973.12 -> elements the first name was last name email in the different inputs by id and we type the

980.16 -> text i use here a library popular java library called faker we use it to generate the test data

990.24 -> and also be careful use save email otherwise if you just use email address it will generate

998.24 -> valid yahoo and gmail email addresses and you may send an email to someone that you don't want to um

1008.4 -> so until here we we filled all of the fields right and then uh we need to uh click on the captcha

1020.64 -> checkbox and to do that if we scroll as i said you you won't be able to and you won't be able

1028.4 -> to because actually the checkbox and the whole captcha it's inside of iframe and iframe is

1035.04 -> actually like a webpage inside the web page and from basic selenium you know that you need to

1040.56 -> switch first to the iframe and then interact with it however this iframe here it doesn't have a

1047.36 -> an id actually it has a random generated name just for this purpose however

1052.4 -> it has this title and we can find it by title when you press ctrl f we can find it by export

1062 -> if you haven't watched there is a whole course about junit and selenium

1066.16 -> 4. inside the both courses i have videos where i talked about advanced expat

1074.56 -> there is a whole view about relative locators in selenium 4 and there

1079.2 -> i also show many advanced expat expressions so check this video out so here

1086.16 -> we can use uh expo light frame then square brackets and again provided with it title equals

1100.08 -> and then this recapture title and this is finding the the iframe and we can wait for it

1108.4 -> to be available this is another option from webdriverweight and when you click it then

1117.28 -> we'll see how it goes after that so um as i said first we need to

1125.68 -> add it here uh we use weight then until methods then we have this static class

1132.96 -> expected conditions were available and switched to it you don't need after that to switch actually if

1140.24 -> you wait for the iframe to be there as i said it's loading a little bit slower just to filter

1148.64 -> some of the balls that are clicking really quick and i provided the expat expression here

1155.76 -> then after that as i said uh when we locate the check box we need to make sure to be uh again the

1165.44 -> checkbox might be there but it might be still not available another element is loaded on top of it

1171.6 -> and uh this you cannot click it right away this is why there is another method here called

1179.44 -> element to be clickable and this will wait for our div with this recapture checkbox border class

1188.16 -> to be clickable and then we'll check it again probably if you run these tests a few times

1197.92 -> the thing that will happen is that this images here will appear and

1204.96 -> now it's the problem how how you battle that if you don't use the hard coded keys that they showed

1211.44 -> actually there is like we can utilize a new technology

1218.64 -> it's many of the cloud platforms nowadays no matter whether it's azure amazon google and others

1225.28 -> they offer this speech-to-text cognitive service or ai that basically can hook to your microphone

1233.2 -> and when when you use the audio version it can listen and it will translate the audio

1239.84 -> into a text then we can get the text and put it in inside and then let's see what will happen again

1250.08 -> all these things that i'm going to show you there for testing purposes only only for your

1256.96 -> test environments don't try to break real catches right and also you will have to

1263.92 -> fine tune the code later however from here i noticed that it's working perfectly fine so

1274.64 -> leveling technique

1278.96 -> now we can copy and verify it's working like a chart right um of course we are not going to use

1288.88 -> their name website actually i registered such a service in my azure account again i'm using

1294.08 -> azure because in some of the projects mainly we use azure but in other projects we use

1299.6 -> amazon in others google it's completely fine the pricing is similar the features are similar so

1309.68 -> how you can find it actually they have cognitive service speech sdk for java i

1317.92 -> already installed it in my project here you just need this additional maven dependency

1326.56 -> called microsoft cognitive service speech then you need to provide the proper key of course

1332.96 -> don't try to use it i mean i already deleted uh my key but i i tried it

1341.04 -> so they have like demos here hr samples cognitive service pitch sdk and we can search for microphone

1356.32 -> so as you can see here in the first example they have this recognized once a sink

1363.76 -> and you will notice that if you use it since the capture they have this security mechanism for

1370.96 -> this background noise then some pauses and because of the pauses actually this will

1375.84 -> take just the first word of it but basically when you initialize again your subscription key

1384 -> in service region you initialize this speech recognizer object and inside of it you have

1392.56 -> this recognizer you you can go recognize once a sync

1397.44 -> let's see they should have another option this is again only once

1407.84 -> you can download the code but basically i am going to show you they have another version i already

1415.76 -> downloaded it and work with it so

1421.36 -> let me show you

1426.24 -> so after we again there is another frame uh when when you click uh on on here when you click here

1437.2 -> there is another iframe that is different from the one that we found for capture so again

1444.72 -> you need to switch to this iframe as well it's called recapture challenge expire in two minutes

1452.32 -> this is what i am doing here again with the same method

1455.6 -> but first you need to switch to default then to this

1460.72 -> another capture another iframe then i click the recapture audio button

1467.68 -> and after that as i said sometimes if you directly copy it from the azure examples

1475.68 -> it may not work directly for this particular captcha it needs some fun

1479.36 -> tuning actually for the website if you try it works every time

1485.68 -> then uh here uh we create the list that will put all the different words that

1493.12 -> uh the speech organizer uh recognizes and then here in in these event listeners

1499.92 -> through lambda i'm initializing anonymous methods where if we recognize the speech

1506.4 -> we are going to add it to this recognized pitch parts and i'm going to print

1511.04 -> and then instead of recognizing once i'm using this start continuous recognition sync and i

1518.08 -> will wait for 10 seconds after i click the play button since this is working in another thread

1526.56 -> and after that i'm going to click the play button that's it then i'm closing all of them

1533.36 -> and the last part is actually where we need to type we need to type the text here this in

1544 -> audio response we find the input through string join passing the list i'm basically configuring

1555.36 -> all the parts inside the list in a single string i'm tapping it we basically

1565.2 -> click the verify button switch to default and click the submit button that's all

1571.84 -> and it works like a charm as i said i deleted it just for security purposes

1580.08 -> um what else uh what's not about this actually there uh there is a really good article about

1588 -> on the london test blog about this how to handle captures in selenium basically i showed you most

1594.32 -> of the stuff um there if you search you will find that there are some paid services to capture or

1602.8 -> for example another by capture.com these are services that they offer different sdks for

1611.2 -> programming languages where basically they're going to break the different types of captures

1620.88 -> and they use actually real humans to solve the captures

1625.28 -> to be honest i wouldn't use them i'm not sure how legal this is and

1631.84 -> i don't know from security perspective i don't think that this is a good idea as i said my

1637.2 -> preferred way is just to disable the captures on test environments and this is just a fun way to

1643.36 -> see how actually ai can help you uh actually in the past when um i had a lecture about cutting

1650.8 -> edge technologies i used actually visual ai to solve these small boxes and to recognize them

1658.56 -> like 50 of the time actually this is working so this is another not really expensive option

1666.24 -> but yeah i hope that this was useful to you um yeah in the next video we are

1672.24 -> going to talk about handling cookies how actually we can use cookies to

1677.12 -> walk in faster to websites how we can deal with this really annoying gdpr notifications and yeah

1688.32 -> it will be really interesting and useful video again thank you for watching please comment below

1696.88 -> if you like the video or if you want to see other different videos

1701.52 -> about selenium and other technologies if you have any questions put them below

1707.36 -> check them on this blog they are really awesome articles there and don't forget to get your

1712.88 -> selenium certification or january 10 hours see you soon in the next video thank you for watching

1738.8 -> you

Source: https://www.youtube.com/watch?v=CCcGPLaaU10