[Release] Parsedom and other functions

[Release] Parsedom and other functions

TobiasTheCommie
Skilled Python Coder

Posts: 618
Joined: Apr 2008
Reputation: 6

TobiasTheCommie
Skilled Python Coder
Posts: 618

#47

2011-12-16, 01:40 (This post was last modified: 2011-12-16, 03:06 by TobiasTheCommie.)

newatv2user Wrote:All of 'em

You never know what codes you may encounter. So I'd go for a comprehensive list of all codes that might be encountered.

This has proven slightly difficult in python.

I've run tests with a random sampling of html entity characters. I have taken the first and the last character in each of the four groups on this page:

http://www.ascii.cl/htmlcodes.htm

And a random sampling of other entities.

- Beautiful Soup
Fails with '.
I wouldn't want to use it anyways.

- htmlentitydefs:
Also fails 5 tests, including the first and last char in all four groups.

- HTMLParser unescape
Passes all tests.
Is not documented.
May only support 128 entities on some systems.

None of these options appeal to me, but I'm inclined to try HTMLParser in 0.9.1 to see if it is something we can rely on.

Note:   will be returned as u"\xa0". That could be replaced with a real space. But since \xa0 is the correct ascii value I'm not sure that's the correct implementation.

Any suggestions?

Developer tools:
Common Cache
Simple Downloader
ParseDOM and utils

Messages In This Thread

[Release] Parsedom(Fast alternative to BeautifulSoup) and other functions - by TobiasTheCommie - 2011-12-08, 21:24

[No subject] - by Popeye - 2011-12-09, 12:01

[No subject] - by TobiasTheCommie - 2011-12-09, 17:42

[No subject] - by Popeye - 2011-12-09, 23:16

[No subject] - by TobiasTheCommie - 2011-12-10, 06:43

[No subject] - by _Pierre_ - 2011-12-10, 12:43

[No subject] - by bossanova808 - 2011-12-11, 06:42

[No subject] - by TobiasTheCommie - 2011-12-11, 13:09

[No subject] - by bossanova808 - 2011-12-11, 14:16

[No subject] - by TobiasTheCommie - 2011-12-11, 14:27

[No subject] - by bossanova808 - 2011-12-11, 14:35

[No subject] - by TobiasTheCommie - 2011-12-12, 01:58

[No subject] - by bossanova808 - 2011-12-12, 08:20

[No subject] - by _Pierre_ - 2011-12-12, 11:40

[No subject] - by TobiasTheCommie - 2011-12-12, 12:13

[No subject] - by TobiasTheCommie - 2011-12-12, 14:03

[No subject] - by _Pierre_ - 2011-12-12, 14:13

[No subject] - by TobiasTheCommie - 2011-12-12, 14:34

[No subject] - by _Pierre_ - 2011-12-12, 15:47

[No subject] - by TobiasTheCommie - 2011-12-12, 16:12

[No subject] - by _Pierre_ - 2011-12-12, 18:13

[No subject] - by TobiasTheCommie - 2011-12-12, 18:55

[No subject] - by _Pierre_ - 2011-12-12, 19:11

[No subject] - by TobiasTheCommie - 2011-12-12, 19:24

[No subject] - by bossanova808 - 2011-12-13, 01:20

[No subject] - by TobiasTheCommie - 2011-12-13, 02:00

[No subject] - by bossanova808 - 2011-12-13, 02:06

[No subject] - by TobiasTheCommie - 2011-12-13, 02:28

[No subject] - by bossanova808 - 2011-12-13, 04:10

[No subject] - by newatv2user - 2011-12-13, 06:53

[No subject] - by TobiasTheCommie - 2011-12-13, 15:55

[No subject] - by newatv2user - 2011-12-13, 17:24

[No subject] - by _Pierre_ - 2011-12-13, 20:18

[No subject] - by TobiasTheCommie - 2011-12-13, 23:08

[No subject] - by _Pierre_ - 2011-12-14, 21:25

[No subject] - by TobiasTheCommie - 2011-12-14, 22:13

[No subject] - by _Pierre_ - 2011-12-14, 22:27

[No subject] - by _Pierre_ - 2011-12-15, 20:11

[No subject] - by Martijn - 2011-12-15, 20:17

[No subject] - by _Pierre_ - 2011-12-15, 20:27

[No subject] - by Martijn - 2011-12-15, 20:32

[No subject] - by _Pierre_ - 2011-12-15, 20:35

[No subject] - by TobiasTheCommie - 2011-12-16, 00:33

[No subject] - by TobiasTheCommie - 2011-12-16, 00:37

[No subject] - by bossanova808 - 2011-12-16, 00:54

[No subject] - by bossanova808 - 2011-12-16, 00:55

[No subject] - by TobiasTheCommie - 2011-12-16, 01:40

[No subject] - by newatv2user - 2011-12-16, 02:17

[No subject] - by TobiasTheCommie - 2011-12-16, 02:29

[No subject] - by takoi - 2011-12-20, 23:54

[No subject] - by TobiasTheCommie - 2011-12-21, 00:25

[No subject] - by takoi - 2011-12-21, 13:35

[No subject] - by stacked - 2011-12-22, 04:05

[No subject] - by TobiasTheCommie - 2011-12-22, 04:07

[No subject] - by takoi - 2011-12-25, 22:34

[No subject] - by TobiasTheCommie - 2011-12-25, 23:48

[No subject] - by takoi - 2011-12-26, 01:54

[No subject] - by TobiasTheCommie - 2011-12-26, 03:57

[No subject] - by takoi - 2012-01-03, 15:06

[No subject] - by TobiasTheCommie - 2012-01-03, 15:46

[No subject] - by takoi - 2012-01-05, 17:47

[No subject] - by TobiasTheCommie - 2012-01-05, 17:59

[No subject] - by takoi - 2012-01-08, 15:19

[No subject] - by TobiasTheCommie - 2012-01-08, 15:30

[No subject] - by BlueCop - 2012-01-09, 23:02

[No subject] - by TobiasTheCommie - 2012-01-27, 01:42

[No subject] - by bossanova808 - 2012-01-27, 07:51

[No subject] - by TobiasTheCommie - 2012-01-27, 13:16

[No subject] - by newatv2user - 2012-01-30, 04:34

[No subject] - by TobiasTheCommie - 2012-01-30, 15:49

[No subject] - by newatv2user - 2012-01-31, 02:18

[No subject] - by TobiasTheCommie - 2012-01-31, 02:24

[No subject] - by newatv2user - 2012-01-31, 02:36

[No subject] - by newatv2user - 2012-01-31, 05:22

[No subject] - by newatv2user - 2012-02-04, 06:14

[No subject] - by TobiasTheCommie - 2012-02-04, 12:08

[No subject] - by newatv2user - 2012-02-04, 16:42

[No subject] - by TobiasTheCommie - 2012-02-04, 17:37

[No subject] - by newatv2user - 2012-02-05, 08:34

[No subject] - by TobiasTheCommie - 2012-02-05, 12:11

[No subject] - by newatv2user - 2012-02-05, 16:51

RE: [Release] Parsedom and other functions - by _Pierre_ - 2012-03-23, 21:56

RE: [Release] Parsedom and other functions - by takoi - 2012-06-09, 13:22

RE: [Release] Parsedom and other functions - by takoi - 2012-06-09, 13:41

RE: [Release] Parsedom and other functions - by takoi - 2012-06-12, 16:43

RE: [Release] Parsedom and other functions - by newatv2user - 2012-07-04, 07:04

RE: [Release] Parsedom and other functions - by stacked - 2012-08-22, 17:15

RE: [Release] Parsedom and other functions - by takoi - 2012-08-23, 11:08

RE: [Release] Parsedom and other functions - by stacked - 2012-08-23, 20:51

RE: [Release] Parsedom and other functions - by mrstealth - 2012-09-19, 17:59

RE: [Release] Parsedom and other functions - by bossanova808 - 2012-09-20, 02:06

RE: [Release] Parsedom and other functions - by bossanova808 - 2012-09-20, 13:03

RE: [Release] Parsedom and other functions - by newatv2user - 2012-09-20, 20:44

RE: [Release] Parsedom and other functions - by bossanova808 - 2012-09-21, 01:50

RE: [Release] Parsedom and other functions - by newatv2user - 2012-09-21, 17:58

[Release] Parsedom and other functions - by bossanova808 - 2012-09-22, 00:43

RE: [Release] Parsedom and other functions - by stacked - 2012-09-22, 17:38

RE: [Release] Parsedom and other functions - by bossanova808 - 2012-09-23, 06:18

RE: [Release] Parsedom and other functions - by newatv2user - 2012-09-26, 04:28

RE: [Release] Parsedom and other functions - by mrstealth - 2012-09-27, 20:40

RE: [Release] Parsedom and other functions - by stacked - 2012-11-23, 19:46

RE: [Release] Parsedom and other functions - by Popeye - 2012-11-23, 21:50

RE: [Release] Parsedom and other functions - by stacked - 2012-11-25, 23:19

RE: [Release] Parsedom and other functions - by Popeye - 2012-11-25, 23:27

RE: [Release] Parsedom and other functions - by newatv2user - 2012-11-29, 21:18

RE: [Release] Parsedom and other functions - by cancan101 - 2012-12-29, 08:20

RE: [Release] Parsedom and other functions - by dschaeggi - 2012-12-29, 14:54

RE: [Release] Parsedom and other functions - by cancan101 - 2012-12-29, 22:15

RE: [Release] Parsedom and other functions - by Kr0nZ - 2013-01-02, 04:57

RE: [Release] Parsedom and other functions - by bit555 - 2013-01-01, 19:14

RE: [Release] Parsedom and other functions - by Kr0nZ - 2013-01-01, 23:53

RE: [Release] Parsedom and other functions - by rmk1139 - 2013-01-02, 10:55

RE: [Release] Parsedom and other functions - by fightnight - 2013-11-07, 20:48

RE: [Release] Parsedom and other functions - by Kib - 2013-11-08, 16:40

RE: [Release] Parsedom and other functions - by Kib - 2013-11-08, 20:03

RE: [Release] Parsedom and other functions - by realtebo - 2014-01-20, 23:35

RE: [Release] Parsedom and other functions - by realtebo - 2014-01-21, 00:05

RE: [Release] Parsedom and other functions - by bossanova808 - 2014-01-21, 00:44

RE: [Release] Parsedom and other functions - by takoi - 2014-01-24, 17:40

RE: [Release] Parsedom and other functions - by takoi - 2014-03-18, 18:29

RE: [Release] Parsedom and other functions - by bossanova808 - 2014-01-28, 01:02

RE: [Release] Parsedom and other functions - by bossanova808 - 2014-01-28, 01:41

RE: [Release] Parsedom and other functions - by nektahiti - 2014-03-16, 06:07

RE: [Release] Parsedom and other functions - by bossanova808 - 2014-03-19, 00:32

RE: [Release] Parsedom and other functions - by takoi - 2014-03-19, 13:00

RE: [Release] Parsedom and other functions - by bossanova808 - 2014-03-20, 03:44

RE: [Release] Parsedom and other functions - by takoi - 2014-03-20, 20:31

RE: [Release] Parsedom and other functions - by bossanova808 - 2014-04-08, 14:30

Logout Mark Read Team Forum Stats Members Help