python - pandas read_html - no tables found after rendering

Question

I am trying to webscrape the second table (Annual Total Return (%) History) from this yahoo page: https://finance.yahoo.com/quote/SPY/performance/

I am using pandas read_html function, but I get an error saying: no table found. I researched a bit and noticed that the page needs dynamic rendering before being able to scrape the data.

So I did the following thing, after checking a post with a similar problem, but i still get the same error (ValueError: No tables found):

from selenium import webdriver

driver = webdriver.Chrome()
driver.get('https://finance.yahoo.com/quote/SPY/performance/')

html = driver.page_source
tables = pd.read_html(html)
data = tables[1]

driver.close()

I am not passing a path to webdriver.Chrome() because the chromedriver.exe is already placed in the jupyter notebook directory.

What am I doing wrong?

Answer 1

等待大神答复