Notifications
Clear all

[Closed] NEW LOOK of this site. Do you like it?

HtmlAgilityPack

it’s what i’m looking at right now

it works pretty well … but i don’t have time right now to write a smart parser:

ass = dotnet.loadassembly @"D:\Downloads\HtmlAgilityPack.dll" 
web = dotnetobject "HtmlAgilityPack.HtmlWeb"
doc = web.Load @"https://forums.cgsociety.org/t/autodesk-masterclass-video-2006/1257849/5"
nodes = doc.DocumentNode.SelectNodes "//meta"
nodes.count

for k=0 to nodes.count-1 do
(
	node = nodes.item[k]
	format "name:%\n\tcontent:%\n" (node.GetAttributeValue "name" "") (node.GetAttributeValue "content" "")
)
	

it definitely works… a dirty way to get all posts from html is:

nodes = doc.DocumentNode.SelectNodes "//div/p"
for k=0 to nodes.count-1 do
(
	node = nodes.item[k]
	format "%\n" node.InnerHtml
)

working with xpath we can find authors, code, links, pictures as well

Thank you @Serejah and @denisT for the examples.

Serejah, regarding your question “Why would search engine web crawlers be allowed to do so?”, because they are one of the biggest components of the business.

That was a rhetorical question. I understand that we’re the absolute minority here. At least according to these numbers
Forum alone gets about 10 million views annual and this section only about 100-150k views for the past two years.

btw Absolute majority of threads could be retrieved with just single request.

thread length post count threads count
short 0 — 20 16489
middle 21 — 40 311
long 40+ 22

No. I don’t like the new look… I find it very difficult to search for old posted scripts, etc.

Should have an update on search today. One of our developers needed time off for 2 weeks. Back on it now

Someone answered in a thread I have posted and 11 (eleven) days later I receive an email notification that there is new post in my thread.

For more than a week when I logIn the site informs me that I have a new PM but I read this “new” PM a week ago.

1 Reply
(@aaandres)
Joined: 10 months ago

Posts: 0

Don’t give up! You just have to answer it an it desapears. Then, the problem is for the other one!

I have answered to this PM when I read it but the notification is still “active” every time when I open the site even if I am not logged.

Page 9 / 10