관리-도구
편집 파일: jslexer.cpython-39.opt-1.pyc
a �`� � @ s� d Z ddlmZ ddlZddlmZ eg d�edd�Zdd d d d d �Z e� dej �Z e� dej �Z e� d�Ze� dej�Ze� d�Ze� dej �Ze� d�Zedd�Zde� dej �fde� d�fde� d�fde� d ej ejB �fd e fd e fd e� d ej�fd!e� d"ej�fd#e� d$d%�eeje�� �fd&e� d'ej �fd(e� d)ejejB �fg Zd*d+� Z d,d-� Z d.d/� Z d2d0d1�Z dS )3z� babel.messages.jslexer ~~~~~~~~~~~~~~~~~~~~~~ A simple JavaScript 1.5 lexer which is used for the JavaScript extractor. :copyright: (c) 2013-2021 by the Babel Team. :license: BSD, see LICENSE for more details. � )� namedtupleN)�unichr)+�+�-�*�%z!=z==�<�>z<=z>=�=z+=z-=z*=z%=z<<z>>z>>>z<<=z>>=z>>>=�&z&=�|z|=z&&z||�^z^=�(�)�[�]�{�}�!�--�++�~�,�;�.�:T)�key�reverse�� � � � )�b�f�n�r�tz[\w$_][\w\d$_]*z[\w$_][\w\d$_.]*[\w\d$_.]z/=?z%/(?:[^/\\]*(?:\\.[^/\\]*)*)/[a-zA-Z]*z (\r\n|\n|\r)z\\z[a-fA-F0-9]{1,4}�Tokenztype value linenoz\s+z<!--.*Z linecommentz//.*Zmultilinecommentz /\*.*?\*/� dotted_name�name�numberzb( (?:0|[1-9]\d*) (\.\d+)? ([eE][-+]?\d+)? | (0x[a-fA-F0-9]+) )Zjsx_tagz(?:</?[^>\s]+|/>)�operatorz(%s)r �template_stringz `(?:[^`\\]*(?:\\.[^`\\]*)*)`�stringzT( '(?:[^'\\]*(?:\\.[^'\\]*)*)' | "(?:[^"\\]*(?:\\.[^"\\]*)*)" )c C sV g }t D ]H\}}| s"|r"d|v r"q|s0|dkr0q|dkrB|s>qd}|�||f� q|S )ze Get a tokenization rule list given the passed syntax options. Internal to this module. �jsxr- r) r* )�_rules�append)r/ �dottedr- �rules� token_type�rule� r6 �:/usr/lib/python3.9/site-packages/babel/messages/jslexer.py� get_rules: s r8 c C s | j dkr| jdv S | j dv S )zzA helper function that helps the tokenizer to decide if the current token may be followed by a division operator. r, )r r r r r )r* r+ r. �regexp)�type�value)�tokenr6 r6 r7 �indicates_divisionN s r= c C s0 t �d| dd� �} g }|j}d}| �d|�}|dk r:�q|| ||� � | |d }|tv rl|t| � n�|dv r�t�| |d �}|dur�|�� }t|�d kr�z|t t |d ��� W n t y� Y n 0 |d }q"||| � |� � }q"q�||� n||� |d }q"|t| �k �r&|| |d� � d � |�S ) z�Unquote a string with JavaScript rules. The string has to start with string delimiters (``'``, ``"`` or the back-tick/grave accent (for template strings).) z\1� ���r �\ZuU� N� � � � )� line_join_re�subr1 �find�escapes� uni_escape_re�match�group�lenr �int� ValueError�end�join)r. �result�add�posZ escape_posZ next_charZescapedZ escaped_valuer6 r6 r7 �unquote_stringW s> rU c c s� d}d}d}t | �}t|||d�}||k r�|D ] \} } | �| |�} | dur. q�q.|rft�| |�} d} nt�| |�} d} | du r�|d7 }q"| �� } | dur�t| | |�} t| �}| V |t t� | ��7 }| � � }q"dS )z� Tokenize JavaScript/JSX source. Returns a generator of tokens. :param jsx: Enable (limited) JSX parsing. :param dotted: Read dotted names as single name token. :param template_string: Support ES6 template strings Fr r> )r/ r2 r- Nr, r9 ) rM r8 rK � division_re�regex_rerL r( r= �line_re�findallrP )�sourcer/ r2 r- Z may_dividerT �linenorP r3 r4 r5 rK Z token_valuer< r6 r6 r7 �tokenize� s2 r\ )TTT) �__doc__� collectionsr �reZ babel._compatr �sortedrM Z operatorsrI �compile�UNICODEZname_reZdotted_name_rerV �DOTALLrW rX �patternrF rJ r( �VERBOSE�IrQ �map�escaper0 r8 r= rU r\ r6 r6 r6 r7 �<module> sF � � �� 8