U
|
¡ý°d¥M ã @ s, d Z ddlmZ ddlZddlZddlZddlZddlZddlZddl m
|
Z
|
m Z m Z m Z mZ ddlmZmZmZ ddlmZmZmZmZmZ ddlmZmZm Z ddl Z G d d
|
d
|
e Z G d d d e Z G d d de Z G dd de Z!G dd de Z"G dd de Z#G dd de Z$G dd de Z%dS )z#Tests of Beautiful Soup as a whole.é )Ú set_traceN)Ú BeautifulSoupÚBeautifulStoneSoupÚGuessedAtParserWarningÚ MarkupResemblesLocatorWarningÚdammit)Úbuilder_registryÚ TreeBuilderÚParserRejectedMarkup)ÚCommentÚ SoupStrainerÚPYTHON_SPECIFIC_ENCODINGSÚTagÚNavigableStringé )Údefault_builderÚ LXML_PRESENTÚSoupTestc @ sL e Zd Zdd Zdd Zdd Zdd Zd d
|
Zd d Zd d Z dd Z
|
dS )ÚTestConstructorc C s" d}| |¡}d|jjks td S )Nu <h1>éé</h1>u éé©ÚsoupÚh1ÚstringÚAssertionError©ÚselfÚdatar © r úJd:\z\workplace\vscode\pyvenv\venv\Lib\site-packages\bs4/tests/test_soup.pyÚtest_short_unicode_input) s
|
z(TestConstructor.test_short_unicode_inputc C s" d}| |¡}d|jjks td S )Nz<h1>foo bar</h1>zfoo barr r r r r Útest_embedded_null. s
|
z"TestConstructor.test_embedded_nullc C s, d d¡}| j|dgd}d|jks(td S )Nu RäksmörgÃ¥súutf-8)Zexclude_encodingsz windows-1252)Úencoder Úoriginal_encodingr )r Ú utf8_datar r r r Útest_exclude_encodings3 s
|
z&TestConstructor.test_exclude_encodingsc C sè G dd dt }tddd}tjdd tdd|i|}W 5 Q R X t|j|sVttdd |jjksltd
|
|jj ks|t|f |}tjdd}td|dd }W 5 Q R X t
|
|d j }| d ¡sÈt||jksÖt||jksätd S )Nc @ sD e Zd Zdd Zdd Zdd Zdd Zd d
|
Ze ZZ d d Z
|
d S )z7TestConstructor.test_custom_builder_class.<locals>.Mockc [ s( || _ d| _d| _g | _g | _i | _d S )NTF)Ú called_withÚis_xmlZstore_line_numbersZcdata_list_attributesZpreserve_whitespace_tagsÚstring_containers)r Úkwargsr r r Ú__init__< s z@TestConstructor.test_custom_builder_class.<locals>.Mock.__init__c S s d S ©Nr ©r r r r r Úinitialize_soupC s zGTestConstructor.test_custom_builder_class.<locals>.Mock.initialize_soupc S s
|
|| _ d S r+ )Úfed)r Úmarkupr r r ÚfeedE s z<TestConstructor.test_custom_builder_class.<locals>.Mock.feedc S s d S r+ r ©r r r r ÚresetG s z=TestConstructor.test_custom_builder_class.<locals>.Mock.resetc S s d S r+ r )r Úignorer r r r3 I s z>TestConstructor.test_custom_builder_class.<locals>.Mock.ignorec s
|
dV d S )N)úprepared markupzoriginal encodingzdeclared encodingz contains replacement charactersr ©r Úargsr) r r r Úprepare_markupL s zFTestConstructor.test_custom_builder_class.<locals>.Mock.prepare_markupN) Ú__name__Ú
|
__module__Ú __qualname__r* r- r0 r2 r3 Zset_up_substitutionsZcan_be_empty_elementr7 r r r r ÚMock; s r; ÚvalueT)ÚvarZconvertEntities©ÚrecordÚ Úbuilder)r= r4 )rA Z ignored_valuer zCKeyword arguments to the BeautifulSoup constructor will be ignored.)r@ ) ÚobjectÚdictÚwarningsÚcatch_warningsr Ú
|
isinstancerA r r& r. ÚstrÚmessageÚ
|
startswith)r r; r) r rA ÚwÚmsgr r r Útest_custom_builder_class8 s* ü
|
ÿz)TestConstructor.test_custom_builder_classc C sX G dd dt }dd }dd l}t t¡}td|d W 5 Q R X dt|jksTtd S ) Nc @ s e Zd Zdd ZdS )z:TestConstructor.test_parser_markup_rejection.<locals>.Mockc _ s t dd S )NzNope.)r
|
r5 r r r r0 l s z?TestConstructor.test_parser_markup_rejection.<locals>.Mock.feedN)r8 r9 r: r0 r r r r r; k s r; c s t d d dfV t d d dfV d S )NF)r/ r5 r r r r7 o s zDTestConstructor.test_parser_markup_rejection.<locals>.prepare_markupr r@ )rA zoThe markup you provided was rejected by the parser. Trying a different parser or a different encoding may help.) r ÚreÚpytestÚraisesr
|
r rG r< r )r r; r7 rM Úexc_infor r r Ú test_parser_markup_rejectionh s z,TestConstructor.test_parser_markup_rejectionc
|
C sÆ d}| |¡}|j}d|d ks$tddg|d ks8t| j |td d}d|jd ksZtddiddifD ]V}tjd d
|
}| j |d |d}W 5 Q R X |j}d dg|d ks°td|d ksjtqjd S ) Nz&<a id=" an id " class=" a class "></a>z an id ÚidÚaÚclass)rA Zmulti_valued_attributesz a class Ú*Tr> Zan)r rS r r rD rE )r r/ r rS Z
|
switcheroorJ r r r Útest_cdata_list_attributes{ s
|
z*TestConstructor.test_cdata_list_attributesc sp G dd dt G dd dtG dd dt | jdt tt id}t fd d
|
| ¡ D sltd S ) Nc @ s e Zd ZdS )z9TestConstructor.test_replacement_classes.<locals>.TagPlusN©r8 r9 r: r r r r ÚTagPlus s rX c @ s e Zd ZdS )z<TestConstructor.test_replacement_classes.<locals>.StringPlusNrW r r r r Ú
|
StringPlus s rY c @ s e Zd ZdS )z=TestConstructor.test_replacement_classes.<locals>.CommentPlusNrW r r r r Ú CommentPlus¡ s rZ z <a><b>foo</b>bar</a><!--whee-->)Zelement_classesc 3 s | ]}t | fV qd S r+ )rF ©Ú.0Úx©rZ rY rX r r Ú <genexpr>¯ s ÿz;TestConstructor.test_replacement_classes.<locals>.<genexpr>)r r r r ÚallZrecursiveChildGeneratorr r, r r^ r Útest_replacement_classes s ýþ þz(TestConstructor.test_replacement_classesc C s G dd dt }G dd dt }| jd||dd}t|jjd t sJtt|jjd |s`t|jjD ]}t||shtqhg |j kstd S ) Nc @ s e Zd ZdS )zATestConstructor.test_alternate_string_containers.<locals>.PStringNrW r r r r ÚPString· s rb c @ s e Zd ZdS )zATestConstructor.test_alternate_string_containers.<locals>.BStringNrW r r r r ÚBStringº s rc z4<div>Hello.<p>Here is <b>some <i>bolded</i></b> text)ÚbÚp)r( r )
|
r r rF ÚdivÚcontentsr re rd ÚstringsZstring_container_stack)r rb rc r Úsr r r Ú test_alternate_string_containers´ s þþ z0TestConstructor.test_alternate_string_containersN) r8 r9 r: r r r% rL rQ rV ra rj r r r r r ' s 0 r c @ sT e Zd Zej dddg¡dd Zej ddd eD d g ¡d
|
d Zd d Z d S )Ú
|
TestOutputz!eventual_encoding,actual_encoding)r! r! )úutf-16rl c C s0 | d¡}d|_d| d|j|dks,td S )Nú <tag></tag>Tz <?xml version="1.0" encoding="z"?>
|
<tag></tag>©Úeventual_encoding)r r' Údecoder )r ro Zactual_encodingr r r r Útest_decode_xml_declarationØ s
|
|
|
|
ÿz&TestOutput.test_decode_xml_declarationro c C s g | ]}|qS r r r[ r r r Ú
|
<listcomp>é s zTestOutput.<listcomp>Nc C s( t dd}d|_d|j|dks$td S )Nrm ú html.parserTz!<?xml version="1.0"?>
|
<tag></tag>rn )r r' rp r )r ro r r r r ÚMtest_decode_xml_declaration_with_missing_or_python_internal_eventual_encodingè s
|
|
|
ÿzXTestOutput.test_decode_xml_declaration_with_missing_or_python_internal_eventual_encodingc C sV | d¡}d|jddks td|jddks2td| ¡ ksBtd| ¡ ksRtd S )Nrm s <tag></tag>r! )Úencodingz <tag>
|
</tag>
|
)r r" r Zencode_contentsZdecode_contentsZprettifyr, r r r Útestô s
|
|
zTestOutput.test)
|
r8 r9 r: rN ÚmarkÚ parametrizerq r rt rv r r r r rk Ö s þÿ
|
|
ÿ
|
rk c @ s° e Zd Zdd Zdd Zdd Zdd Zd d
|
Zd d Zd d Z dd Z
|
e j dddddddddg¡dd Ze j dd d d d g¡d d! Zd"d# Zd$d% Zd&d' Zd(d) Zd*S )+Ú TestWarningsc C s@ |D ]&}t |j|r|jtks"t| S qtd||f d S )Nz%s warning not found in %r)rF rH ÚfilenameÚ__file__r Ú Exception)r rD ÚclsrJ r r r Ú_assert_warning s
|
|
z TestWarnings._assert_warningc C s2 | |t¡}t|j}| tjd d
¡s.td S )Né< )r~ r rG rH rI r ZNO_PARSER_SPECIFIED_WARNINGr )r rJ ÚwarningrH r r r Ú_assert_no_parser_specified s
|
z(TestWarnings._assert_no_parser_specifiedc C s. t jdd}td}W 5 Q R X | |¡ d S ©NTr> ú<a><b></b></a>©rD rE r r ©r rJ r r r r Ú#test_warning_if_no_parser_specified s z0TestWarnings.test_warning_if_no_parser_specifiedc C s0 t jdd}tdd}W 5 Q R X | |¡ d S )NTr> r Úhtmlr r
r r r Ú*test_warning_if_parser_specified_too_vague s z7TestWarnings.test_warning_if_parser_specified_too_vaguec C s2 t jdd}| d¡}W 5 Q R X g |ks.td S r ©rD rE r r r
r r r Ú,test_no_warning_if_explicit_parser_specified s z9TestWarnings.test_no_warning_if_explicit_parser_specifiedc C sl t jdd}tddtdd}W 5 Q R X | |t¡}t|j}d|ksLtd|ksXtd | ¡ kshtd S )
|
NTr> r rs rd )ÚparseOnlyTheser Ú
|
parse_onlys <b></b>)
|
rD rE r r r~ ÚDeprecationWarningrG rH r r" )r rJ r r rK r r r Ú)test_parseOnlyThese_renamed_to_parse_only" s þ
|
z6TestWarnings.test_parseOnlyThese_renamed_to_parse_onlyc C sj t jdd}d}t|ddd}W 5 Q R X | |t¡}t|j}d|ksLtd|ksXtd|jksftd S ) NTr> s érs Úutf8)Ú fromEncodingr Z from_encoding) rD rE r r~ r rG rH r r# )r rJ r r r rK r r r Ú*test_fromEncoding_renamed_to_from_encoding. s ÿ
|
z7TestWarnings.test_fromEncoding_renamed_to_from_encodingc C s( t t¡ | jddd W 5 Q R X d S )Nz<a>T)Zno_such_argument)rN rO Ú TypeErrorr r1 r r r Ú"test_unrecognized_keyword_argument: s z/TestWarnings.test_unrecognized_keyword_argumentÚ extensionz markup.htmlz
|
markup.htmz markup.HTMLz
|
markup.txtz markup.xhtmlz
|
markup.xmlz/home/user/filez c:\user ilec C sH t jdd2}td| d}| |t¡}dt|jks:tW 5 Q R X d S )NTr> r/ rs zlooks more like a filename©rD rE r r~ r rG rH r )r r rJ r r r r r Ú test_resembles_filename_warning> s z,TestWarnings.test_resembles_filename_warningZ
|
markuphtmlz
|
markup.comr@ z markup.jsc C s6 t jdd}| d| ¡}W 5 Q R X g |ks2td S )NTr> r/ r )r r rJ r r r r Ú"test_resembles_filename_no_warningK s z/TestWarnings.test_resembles_filename_no_warningc C s` d}t jdd}t|d}W 5 Q R X | |t¡}dt|jksDt|t|j d¡ks\td S )Ns http://www.crummybytes.com/Tr> rs úlooks more like a URLr ) rD rE r r~ r rG rH r r" ©r ÚurlÚ warning_listr r r r r Ú test_url_warning_with_bytes_urlW s ÿz,TestWarnings.test_url_warning_with_bytes_urlc C sZ d}t jdd}t|d}W 5 Q R X | |t¡}dt|jksDt|t|jksVtd S )Nz http://www.crummyunicode.com/Tr> rs r r r r r r Ú!test_url_warning_with_unicode_urla s ÿz.TestWarnings.test_url_warning_with_unicode_urlc C s< t jdd}| d¡}W 5 Q R X tdd |D r8td S )NTr> s$ http://www.crummybytes.com/ is greatc s s | ]}d t |jkV qdS ©r N©rG rH ©r\ rJ r r r r_ r s ÿzETestWarnings.test_url_warning_with_bytes_and_space.<locals>.<genexpr>©rD rE r Úanyr ©r r r r r r Ú%test_url_warning_with_bytes_and_spacem s
|
ÿz2TestWarnings.test_url_warning_with_bytes_and_spacec C s< t jdd}| d¡}W 5 Q R X tdd |D r8td S )NTr> z&http://www.crummyunicode.com/ is greatc s s | ]}d t |jkV qdS r r r r r r r_ x s ÿzGTestWarnings.test_url_warning_with_unicode_and_space.<locals>.<genexpr>r¡ r£ r r r Ú'test_url_warning_with_unicode_and_spaceu s
|
ÿz4TestWarnings.test_url_warning_with_unicode_and_spaceN)r8 r9 r: r~ r r r r r r r rN rw rx r r r r r¤ r¥ r r r r ry ÿ s6 ÿþ
|
|
þ
|
|
ry c @ s e Zd Zdd ZdS )ÚTestSelectiveParsingc C s. d}t d}| j||d}| ¡ dks*td S )Nz&No<b>Yes</b><a>No<b>Yes <c>Yes</c></b>rd )r s <b>Yes</b><b>Yes <c>Yes</c></b>)r r r" r )r r/ Zstrainerr r r r Ú test_parse_with_soupstrainer~ s z1TestSelectiveParsing.test_parse_with_soupstrainerN)r8 r9 r: r§ r r r r r¦ | s r¦ c @ s: e Zd ZdZdd Zejje dddd Z dd Z
|
d
|
S ) Ú
|
TestNewTagz(Test the BeautifulSoup.new_tag() method.c C sb | d¡}|jddddid}t|ts,td|jks:ttddd|jksPtd |jks^td S )Nr@ ÚfooZbazÚnameza name)ÚbarÚattrs)r« rª ) r Únew_tagrF r r rª rC r¬ Úparent)r r r r r r Ú test_new_tag s
|
zTestNewTag.test_new_tagz-lxml not installed, cannot parse XML document)Úreasonc C sB t dd}| d¡}| d¡}d| ¡ ks.td| ¡ ks>td S )Nr@ ÚxmlÚbrre ó <br/>s <p/>©r r r" r )r Zxml_soupZxml_brZxml_pr r r Ú5test_xml_tag_inherits_self_closing_rules_from_builder s
|
|
|
|
z@TestNewTag.test_xml_tag_inherits_self_closing_rules_from_builderc C sB t dd}| d¡}| d¡}d| ¡ ks.td| ¡ ks>td S )Nr@ rs r² re r³ s <p></p>r´ )r Z html_soupZhtml_brZhtml_pr r r Ú1test_tag_inherits_self_closing_rules_from_builder s
|
|
|
|
z<TestNewTag.test_tag_inherits_self_closing_rules_from_builderN) r8 r9 r: Ú__doc__r¯ rN rw Zskipifr rµ r¶ r r r r r¨
s þ
|
|
r¨ c @ s e Zd ZdZdd Zdd ZdS )Ú TestNewStringz+Test the BeautifulSoup.new_string() method.c C s2 | d¡}| d¡}d|ks tt|ts.td S ©Nr@ r© )r Ú
|
new_stringr rF r ©r r ri r r r Ú'test_new_string_creates_navigablestring© s
|
|
z5TestNewString.test_new_string_creates_navigablestringc C s4 | d¡}| dt¡}d|ks"tt|ts0td S r¹ )r rº r r rF r» r r r Ú3test_new_string_can_create_navigablestring_subclass¯ s
|
zATestNewString.test_new_string_can_create_navigablestring_subclassN)r8 r9 r: r· r¼ r½ r r r r r¸ § s r¸ c @ s e Zd Zdd Zdd ZdS )Ú
|
TestPicklec C s2 | d¡}t |¡}t |¡}d|jjks.td S )Nz<a>some markup</a>ú some markup)r ÚpickleÚdumpsÚloadsrS r r ©r r ZpickledZ unpickledr r r Útest_normal_pickle¹ s
|
|
|
z TestPickle.test_normal_picklec C s6 | d¡}d |_t |¡}t |¡}d|jks2td S )Nr¿ )r rA rÀ rÁ r r r rà r r r Útest_pickle_with_no_builder¿ s
|
|
|
|
z&TestPickle.test_pickle_with_no_builderN)r8 r9 r: rÄ rÅ r r r r r¾ ¶ s r¾ c @ s4 e Zd Zdd Zdd Zdd Zdd Zd d
|
Zd S ) ÚTestEncodingConversionc C s& d| _ | j d¡| _| jdks"td S )NuU <html><head><meta charset="utf-8"/></head><body><foo>Sacré bleu!</foo></body></html>r! sU <html><head><meta charset="utf-8"/></head><body><foo>Sacré bleu!</foo></body></html>)Ú unicode_datar" r$ r r1 r r r Ú setup_methodÌ s z#TestEncodingConversion.setup_methodc C s t j}t tj¡ z^dd }|t _d}| |¡}| ¡ }t|t sFt
|
|| | ¡ ¡ks\t
|
|j ¡ dksnt
|
W 5 t tj¡ |t _X d S )Nc S s d S r+ r )rG r r r ÚnoopØ s z>TestEncodingConversion.test_ascii_in_unicode_out.<locals>.noops <foo>a</foo>r! )r Zchardet_dammitÚloggingÚdisableÚWARNINGÚNOTSETr rp rF rG r Z document_forr# Úlower)r ÚchardetrÉ ÚasciiZsoup_from_asciiZunicode_outputr r r Útest_ascii_in_unicode_outÒ s
|
z0TestEncodingConversion.test_ascii_in_unicode_outc C s@ | | j¡}| ¡ | jks t|jjdks.t|jd ks<td S ©Nu Sacré bleu!)r rÇ rp r r© r r# ©r Zsoup_from_unicoder r r Útest_unicode_in_unicode_outæ s z2TestEncodingConversion.test_unicode_in_unicode_outc C s2 | | j¡}| ¡ | jks t|jjdks.td S rÒ )r r$ rp rÇ r r© r )r Zsoup_from_utf8r r r Útest_utf8_in_unicode_outî s z/TestEncodingConversion.test_utf8_in_unicode_outc C s$ | | j¡}| d¡| jks td S )Nr! )r rÇ r" r$ r rÓ r r r Ú test_utf8_outõ s z$TestEncodingConversion.test_utf8_outN)r8 r9 r: rÈ rÑ rÔ rÕ rÖ r r r r rÆ È s
|
rÆ )&r· Úpdbr rÊ ÚosrÀ rN ÚsysÚtempfileZbs4r r r r r Z bs4.builderr r r
|
Z bs4.elementr r r r r r@ r r r rD r rk ry r¦ r¨ r¸ r¾ rÆ r r r r Ú<module> s* 0)} "
|
