htmlParse

cheneytw

请问htmlParse返回的结果是否有size限制?
我用下面一段code htmlParse返回只有到[[288]],似乎没有抓完?
如果是size的限制有办法解决吗?


URL = "http://isin.twse.com.tw/isin/C_public.jsp?strMode=2"
test_doc = htmlParse(URL,encoding="big5")
test = test_doc["//tr"]

:cry:

ryo

>library(rvest)
>library(pipeR)
>URL %>>% html_session %>>% html_nodes('tr')

papillon

> URL = "http://isin.twse.com.tw/isin/C_public.jsp?strMode=2"
> test_doc = htmlParse(URL,encoding="big5")
> test = test_doc["//tr"]
> length(test)
[1] 11393
>
再试试?

cheneytw

跟版本有差別??
> library(XML)
> library(bitops)
> library(httr)
> library(RCurl)
> URL = "http://isin.twse.com.tw/isin/C_public.jsp?strMode=2"
> test_doc = htmlParse(URL,encoding="big5")
> test = test_doc["//tr"]
> length(test)
[1] 288
> sessionInfo()
R version 3.2.0 (2015-04-16)
Platform: x86_64-w64-mingw32/x64 (64-bit)
Running under: Windows 7 x64 (build 7601) Service Pack 1

locale:
[1] LC_COLLATE=Chinese (Traditional)_Taiwan.950
[2] LC_CTYPE=Chinese (Traditional)_Taiwan.950
[3] LC_MONETARY=Chinese (Traditional)_Taiwan.950
[4] LC_NUMERIC=C
[5] LC_TIME=Chinese (Traditional)_Taiwan.950

attached base packages:
[1] stats graphics grDevices utils datasets methods
[7] base

other attached packages:
[1] httr_0.6.1 XML_3.98-1.1 RCurl_1.95-4.6 bitops_1.0-6

loaded via a namespace (and not attached):
[1] tools_3.2.0 stringr_0.6.2

cheneytw

>library(rvest)
>library(pipeR)
>URL %>>% html_session %>>% html_nodes('tr')

這個可以~~ :devil: :D

cheneytw


> html_session("http://isin.twse.com.tw/isin/C_public.jsp?strMode=2",encoding="big5")
<session> http://isin.twse.com.tw/isin/C_public.jsp?strMode=2
  Status: 200
  Type:   text/html;charset=MS950
  Size:   2656781
>

編碼好怪怪的,charset應該是big5才對 :?: :?:

html_session出來好像都是MS950 :plain: :plain: