Spaces:

data354
/

finchat

Sleeping

Monsia commited on Apr 15, 2024

Commit

782be8b

1 Parent(s): 8bfa348

fix: scraper bug

Files changed (1) hide show

scrape_data.py CHANGED Viewed

@@ -53,8 +53,8 @@ def scrap_articles(
         submit_btn.click()
         dates = driver.find_elements(By.CLASS_NAME, "sp1")
-        titles = driver.find_elements(By.XPATH, "//td/a")
         articles = []
         for i in range(len(titles)):
             art = {

         submit_btn.click()
         dates = driver.find_elements(By.CLASS_NAME, "sp1")
+        table = driver.find_element(By.ID, "tabQuotes")
+        titles = table.find_elements(By.TAG_NAME, "a")
         articles = []
         for i in range(len(titles)):
             art = {