File: //lib/python3.9/site-packages/google/protobuf/__pycache__/text_format.cpython-39.pyc
a
x��g � �
@ s& d Z dZddlZddlZddlZddlZddlZddlZddl m
Z
ddl m Z ddl m
Z
ddl mZ ejrreZg d�Ze �� e �� e �� e �� fZe�d ej�Ze�d
ej�Ze d �Z d Z G d
d� de �Z G dd� de �Z!G dd� de"�Z#dTdd�Z$dd� Z%dd� Z&dUdd�Z'dVd d �Z(dWd d �Z)d d!� Z*d"Z+d#Z,G d$d%� d%e"�Z-dXd&d'�Z.dYd(d)�Z/dZd*d+�Z0d[d,d-�Z1G d.d/� d/e"�Z2d0d1� Z3d2d3� Z4d4d5� Z5d6d7� Z6G d8d9� d9e"�Z7e7Z8d:d;� Z9d<d=� Z:d>d?� Z;d@dA� Z<dBdC� Z=dDdE� Z>d\dFdG�Z?d]dHdI�Z@d^dJdK�ZAd_dLdM�ZBdNdO� ZCdPdQ� ZDdRdS� ZEdS )`ac Contains routines for printing protocol messages in text format.
Simple usage example::
# Create a proto object and serialize it to a text proto string.
message = my_proto_pb2.MyMessage(foo='bar')
text_proto = text_format.MessageToString(message)
# Parse a text proto string.
message = text_format.Parse(text_proto, my_proto_pb2.MyMessage())
z kenton@google.com (Kenton Varda)� N)�decoder)�
type_checkers)�
descriptor)�
text_encoding)�MessageToString�Parse� PrintMessage�
PrintField�PrintFieldValue�Merge�MessageToBytesz-?inf(?:inity)?f?$znanf?$)�'�"zgoogle.protobuf.Anyc @ s e Zd ZdZdS )�Errorz'Top-level module error for text_format.N)�__name__�
__module__� __qualname__�__doc__� r r �?/usr/lib/python3.9/site-packages/google/protobuf/text_format.pyr K s r c s2 e Zd ZdZd � fdd� Zdd� Zdd� Z� ZS )
�
ParseErrorz3Thrown in case of text parsing or tokenizing error.Nc sr |d ur:|d ur:t |�}|d ur.|d�|�7 }d�||�}|d urTtt| ��|� ntt| ��� || _|| _d S )Nz:{0}z {0} : {1})�str�format�superr �__init__�_line�_column)�self�message�line�column�loc�� __class__r r r R s zParseError.__init__c C s | j S �N)r �r r r r �GetLine_ s zParseError.GetLinec C s | j S r$ )r r% r r r � GetColumnb s zParseError.GetColumn)NNN)r r r r r r& r' �
__classcell__r r r" r r O s
r c @ s, e Zd Zdd� Zdd� Zdd� Zdd� Zd S )
�
TextWriterc C s t jrt�� | _n
t�� | _d S r$ )�six�PY2�io�BytesIO�_writer�StringIO)r �as_utf8r r r r h s zTextWriter.__init__c C s( t jr t|t j�r |�d�}| j�|�S )N�utf-8)r* r+ �
isinstance� text_type�encoder. �write)r �valr r r r5 n s
zTextWriter.writec C s
| j �� S r$ )r. �closer% r r r r7 t s zTextWriter.closec C s
| j �� S r$ )r. �getvaluer% r r r r8 w s zTextWriter.getvalueN)r r r r r5 r7 r8 r r r r r) f s r) Fc C sV t |�}t||
||||||||| | | |
d�}|�| � |�� }|�� |rR|�� S |S )aT Convert protobuf message to text format.
Double values can be formatted compactly with 15 digits of
precision (which is the most that IEEE 754 "double" can guarantee)
using double_format='.15g'. To ensure that converting to text and back to a
proto will result in an identical value, double_format='.17g' should be used.
Args:
message: The protocol buffers message.
as_utf8: Return unescaped Unicode for non-ASCII characters.
In Python 3 actual Unicode characters may appear as is in strings.
In Python 2 the return value will be valid UTF-8 rather than only ASCII.
as_one_line: Don't introduce newlines between fields.
use_short_repeated_primitives: Use short repeated format for primitives.
pointy_brackets: If True, use angle brackets instead of curly braces for
nesting.
use_index_order: If True, fields of a proto message will be printed using
the order defined in source code instead of the field number, extensions
will be printed at the end of the message and their relative order is
determined by the extension number. By default, use the field number
order.
float_format (str): If set, use this to specify float field formatting
(per the "Format Specification Mini-Language"); otherwise, shortest float
that has same value in wire will be printed. Also affect double field
if double_format is not set but float_format is set.
double_format (str): If set, use this to specify double field formatting
(per the "Format Specification Mini-Language"); if it is not set but
float_format is set, use float_format. Otherwise, use ``str()``
use_field_number: If True, print field numbers instead of names.
descriptor_pool (DescriptorPool): Descriptor pool used to resolve Any types.
indent (int): The initial indent level, in terms of spaces, for pretty
print.
message_formatter (function(message, indent, as_one_line) -> unicode|None):
Custom formatter for selected sub-messages (usually based on message
type). Use to pretty print parts of the protobuf for easier diffing.
print_unknown_fields: If True, unknown fields will be printed.
force_colon: If set, a colon will be added after the field name even if the
field is a proto message.
Returns:
str: A string of the text formatted protocol buffer message.
)�print_unknown_fields� force_colon)r) �_Printerr r8 r7 �rstrip)r r0 � as_one_line� use_short_repeated_primitives�pointy_brackets�use_index_order� float_format�
double_format�use_field_number�descriptor_pool�indent�message_formatterr9 r: �out�printer�resultr r r r { s. :�
r c K s: t | fi |��}t|t�r |S |�d�r,dnd}|�|�S )zFConvert protobuf message to encoded text format. See MessageToString.r0 r1 �ascii)r r2 �bytes�getr4 )r �kwargs�text�codecr r r r � s
r c C s" | j tjjko | jjo | j�� jS r$ )�typer �FieldDescriptor� TYPE_MESSAGE� message_typeZ has_options�
GetOptionsZ map_entry)�fieldr r r � _IsMapEntry� s
�
�rV c C s2 t ||||||||| |
| | |
|d�}|�| � d S )N�rG rE r0 r= r> r? r@ rA rB rC rD rF r9 r: )r; r )r rG rE r0 r= r> r? r@ rA rB rC rD rF r9 r: rH r r r r � s �
r c C s0 t |||||||| |
| | |
d� }|�| |� dS )�%Print a single field name/value pair.�rF r9 r: N)r; r �rU �valuerG rE r0 r= r> r? r@ rA rB rF r9 r: rH r r r r � s
�r c C s0 t |||||||| |
| | |
d� }|�| |� dS )z0Print a single field value (not including name).rY N)r; r
rZ r r r r
s
�r
c C sd |du r ddl m} |�� }ddl m} |�� }z|�| �}W n tyR Y dS 0 |�|�}|� S )a! Returns a protobuf message instance.
Args:
type_name: Fully-qualified protobuf message type name string.
descriptor_pool: DescriptorPool instance.
Returns:
A Message instance of type matching type_name, or None if the a Descriptor
wasn't found matching type_name.
Nr )rD )�symbol_database)�google.protobufrD ZDefaultr\ ZFindMessageTypeByName�KeyErrorZ GetPrototype)� type_namerD Zpool_modr\ Zdatabase�message_descriptorrS r r r �_BuildMessageFromTypeName, s
ra � � c
@ sb e Zd ZdZddd�Zdd� Zd d
� Zd d � Zd
d� Zdd� Z dd� Z
dd� Z dd� Z dd� Z
dS )r; z)Text format printer for protocol message.r FNc C sh || _ || _|| _|| _|| _|| _|| _|| _| dur@| | _n|| _|
| _ | | _
| | _ |
| _ || _
dS )af Initialize the Printer.
Double values can be formatted compactly with 15 digits of precision
(which is the most that IEEE 754 "double" can guarantee) using
double_format='.15g'. To ensure that converting to text and back to a proto
will result in an identical value, double_format='.17g' should be used.
Args:
out: To record the text format result.
indent: The initial indent level for pretty print.
as_utf8: Return unescaped Unicode for non-ASCII characters.
In Python 3 actual Unicode characters may appear as is in strings.
In Python 2 the return value will be valid UTF-8 rather than ASCII.
as_one_line: Don't introduce newlines between fields.
use_short_repeated_primitives: Use short repeated format for primitives.
pointy_brackets: If True, use angle brackets instead of curly braces for
nesting.
use_index_order: If True, print fields of a proto message using the order
defined in source code instead of the field number. By default, use the
field number order.
float_format: If set, use this to specify float field formatting
(per the "Format Specification Mini-Language"); otherwise, shortest
float that has same value in wire will be printed. Also affect double
field if double_format is not set but float_format is set.
double_format: If set, use this to specify double field formatting
(per the "Format Specification Mini-Language"); if it is not set but
float_format is set, use float_format. Otherwise, str() is used.
use_field_number: If True, print field numbers instead of names.
descriptor_pool: A DescriptorPool used to resolve Any types.
message_formatter: A function(message, indent, as_one_line): unicode|None
to custom format selected sub-messages (usually based on message type).
Use to pretty print parts of the protobuf for easier diffing.
print_unknown_fields: If True, unknown fields will be printed.
force_colon: If set, a colon will be added after the field name even if
the field is a proto message.
NrW )r rG rE r0 r= r> r? r@ rA rB rC rD rF r9 r: r r r r M s 4z_Printer.__init__c C s� d|j vrdS t|�� | j�}|r~|�|j� | jr8dnd}| j�d| j d |j |f � | �
|� | j�| j rtdnd� dS dS d S )
z5Serializes if message is a google.protobuf.Any field.�/F�:� z %s[%s]%s � �
TN) Ztype_urlra ZTypeNamerD ZMergeFromStringr[ r: rG r5 rE �_PrintMessageFieldValuer= )r r Zpacked_message�colonr r r �_TryPrintAsAnyMessage� s
�
z _Printer._TryPrintAsAnyMessagec C sV | � || j| j�}|d u r dS | j}|�d| j � |�|� |�| jrLdnd� dS )NFrg rh T)rF rE r= rG r5 )r r � formattedrG r r r �_TryCustomFormatMessage� s
z _Printer._TryCustomFormatMessagec C s | j r| �|�rdS |jjtkr.| �|�r.dS |�� }| jrL|jdd� d� |D ]�\}}t |�r�t
|�D ]$}|� � ||| d�}| � ||� qhqP|j
tjjkr�| jr�|jtjjkr�|jtjjkr�| �||� q�|D ]}| � ||� q�qP| � ||� qP| j�r
| �|�� � dS )zeConvert protobuf message to text format.
Args:
message: The protocol buffers message.
Nc S s | d j r| d jS | d jS �Nr )� is_extension�number�index)�xr r r �<lambda>� � z'_Printer.PrintMessage.<locals>.<lambda>)�key)ru r[ )rF rm �
DESCRIPTOR� full_name�_ANY_FULL_TYPE_NAMErk Z
ListFieldsr@ �sortrV �sorted�
GetEntryClassr �labelr rQ �LABEL_REPEATEDr> �cpp_type�CPPTYPE_MESSAGE�CPPTYPE_STRING�"_PrintShortRepeatedPrimitivesValuer9 �_PrintUnknownFieldsZ
UnknownFields)r r �fieldsrU r[ ru Z entry_submsg�elementr r r r � s8 �� � �z_Printer.PrintMessagec C s� | j }|D �]�}|�d| j � |�t|j�� |jtkr�| jrL|�d� n|�d� | jd7 _| �|j � | jr�|�d� n"| jd8 _|�d| j d � q
|jt
k�r�z"t � t
|j �dt|j ��\}}W n ty� d}Y n0 |t|j �k�rj| j�r|�d� n|�d� | jd7 _| �|� | j�rF|�d� n"| jd8 _|�d| j d � n4|�d� |�t�|j d �� |�| j�r�d
nd � q
|�d � |�t|j �� |�| j�r�dnd
� q
dS )zPrint unknown fields.rg z { z {
rb z} z}
r z: "Fz" z"
z: rh N)rG r5 rE r Z field_numberZ wire_type�WIRETYPE_START_GROUPr= r� �data�WIRETYPE_LENGTH_DELIMITEDr Z_DecodeUnknownFieldSet�
memoryview�len� Exceptionr �CEscape)r Zunknown_fieldsrG rU Zembedded_unknown_message�posr r r r� � sJ
�
z _Printer._PrintUnknownFieldsc C s� | j }|�d| j � | jr.|�t|j�� n�|jr�|�d� |j�� j rv|j
t j j
krv|jt j jkrv|�|jj� n |�|j� |�d� n*|j
t j jkr�|�|jj� n |�|j� | js�|jt j jkr�|�d� dS )zPrint field name.rg �[�]re N)rG r5 rE rC r rp ro �containing_typerT Zmessage_set_wire_formatrP r rQ rR r| ZLABEL_OPTIONALrS rw �
TYPE_GROUP�namer: r~ r )r rU rG r r r �_PrintFieldName s*
� � �z_Printer._PrintFieldNamec C s< | � |� | j�d� | �||� | j�| jr2dnd� dS )rX rg rh N)r� rG r5 r
r= )r rU r[ r r r r ) s
z_Printer.PrintFieldc C s� | � |� | j�d� tj�t|�d �D ] }| �||| � | j�d� q*| �||d � | j�d� | jrz| j�d� | j�| j r�dnd� d S )
z("Prints short repeated primitives value.z [� z, ���r� re rg rh N)
r� rG r5 r* Zmoves�ranger� r
r: r= )r rU r[ �ir r r r� 0 s
z+_Printer._PrintShortRepeatedPrimitivesValuec C s� | j rd}d}nd}d}| jrF| j�d| � | �|� | j�|� nL| j�d| � | jd7 _| �|� | jd8 _| j�d| j | � d S ) N�<�>�{�}z%s z%s
rb rg )r? r= rG r5 r rE )r r[ ZopenbZclosebr r r ri > s
z _Printer._PrintMessageFieldValuec C s� | j }|jtjjkr"| �|� �n�|jtjjkrh|jj� |d�}|durV|�
|j � n|�
t |�� �nJ|jtjj
kr�|�
d� t|tj�r�tjs�| js�|�d�}n|}|jtjjkr�d}n| j}|�
t�||�� |�
d� n�|jtjjk�r|�r|�
d� n
|�
d� n�|jtjjk�rr| jdu�r@|�
d�| j|�� n0t � |��r\|�
t |�� n|�
t t � |��� n@|jtjj k�r�| j!du�r�|�
d�| j!|�� n|�
t |�� dS )z�Print a single field value (not including name).
For repeated fields, the value should be a single element.
Args:
field: The descriptor of the field to be printed.
value: The value of the field.
Nr r1 F�true�falsez{1:{0}})"rG r~ r rQ r ri Z CPPTYPE_ENUM� enum_type�values_by_numberrL r5 r� r r� r2 r* r3 r+ r0 r4 rP �
TYPE_BYTESr r� Z CPPTYPE_BOOLZ
CPPTYPE_FLOATrA r �mathZisnanr ZToShortestFloatZCPPTYPE_DOUBLErB )r rU r[ rG �
enum_valueZ out_valueZ out_as_utf8r r r r
Q sB
�z_Printer.PrintFieldValue)
r FFFFFNNFNNFF)r r r r r rk rm r r� r� r r� ri r
r r r r r; J s0 �
F '7 r; c C s( t | �t| t�rdnd�|||||d�S )a Parses a text representation of a protocol message into a message.
NOTE: for historical reasons this function does not clear the input
message. This is different from what the binary msg.ParseFrom(...) does.
If text contains a field already set in message, the value is appended if the
field is repeated. Otherwise, an error is raised.
Example::
a = MyProto()
a.repeated_field.append('test')
b = MyProto()
# Repeated fields are combined
text_format.Parse(repr(a), b)
text_format.Parse(repr(a), b) # repeated_field contains ["test", "test"]
# Non-repeated fields cannot be overwritten
a.singular_field = 1
b.singular_field = 2
text_format.Parse(repr(a), b) # ParseError
# Binary version:
b.ParseFromString(a.SerializeToString()) # repeated_field is now "test"
Caller is responsible for clearing the message as needed.
Args:
text (str): Message text representation.
message (Message): A protocol buffer message to merge into.
allow_unknown_extension: if True, skip over missing extensions and keep
parsing
allow_field_number: if True, both field number and field name are allowed.
descriptor_pool (DescriptorPool): Descriptor pool used to resolve Any types.
allow_unknown_field: if True, skip over unknown field and keep
parsing. Avoid to use this option if possible. It may hide some
errors (e.g. spelling error on field name)
Returns:
Message: The same message passed as argument.
Raises:
ParseError: On text parsing problems.
�
rh �rD �allow_unknown_field)�
ParseLines�splitr2 rK �rN r �allow_unknown_extension�allow_field_numberrD r� r r r r � s 2�r c C s( t | �t| t�rdnd�|||||d�S )a� Parses a text representation of a protocol message into a message.
Like Parse(), but allows repeated values for a non-repeated field, and uses
the last one. This means any non-repeated, top-level fields specified in text
replace those in the message.
Args:
text (str): Message text representation.
message (Message): A protocol buffer message to merge into.
allow_unknown_extension: if True, skip over missing extensions and keep
parsing
allow_field_number: if True, both field number and field name are allowed.
descriptor_pool (DescriptorPool): Descriptor pool used to resolve Any types.
allow_unknown_field: if True, skip over unknown field and keep
parsing. Avoid to use this option if possible. It may hide some
errors (e.g. spelling error on field name)
Returns:
Message: The same message passed as argument.
Raises:
ParseError: On text parsing problems.
r� rh r� )�
MergeLinesr� r2 rK r� r r r r � s �r c C s t ||||d�}|�| |�S )a� Parses a text representation of a protocol message into a message.
See Parse() for caveats.
Args:
lines: An iterable of lines of a message's text representation.
message: A protocol buffer message to merge into.
allow_unknown_extension: if True, skip over missing extensions and keep
parsing
allow_field_number: if True, both field number and field name are allowed.
descriptor_pool: A DescriptorPool used to resolve Any types.
allow_unknown_field: if True, skip over unknown field and keep
parsing. Avoid to use this option if possible. It may hide some
errors (e.g. spelling error on field name)
Returns:
The same message passed as argument.
Raises:
ParseError: On text parsing problems.
r� )�_Parserr� ��linesr r� r� rD r� �parserr r r r� � s �r� c C s t ||||d�}|�| |�S )a� Parses a text representation of a protocol message into a message.
See Merge() for more details.
Args:
lines: An iterable of lines of a message's text representation.
message: A protocol buffer message to merge into.
allow_unknown_extension: if True, skip over missing extensions and keep
parsing
allow_field_number: if True, both field number and field name are allowed.
descriptor_pool: A DescriptorPool used to resolve Any types.
allow_unknown_field: if True, skip over unknown field and keep
parsing. Avoid to use this option if possible. It may hide some
errors (e.g. spelling error on field name)
Returns:
The same message passed as argument.
Raises:
ParseError: On text parsing problems.
r� )r� r� r� r r r r� s �r� c @ s^ e Zd ZdZddd�Zdd� Zdd � Zd
d � Zd d
� Zdd� Z dd� Z
e dd� �Z dd� Z
dS )r� z(Text format parser for protocol message.FNc C s || _ || _|| _|| _d S r$ )r� r� rD r� )r r� r� rD r� r r r r + s z_Parser.__init__c C s d| _ | �||� |S )zBParses a text representation of a protocol message into a message.F��_allow_multiple_scalars�
_ParseOrMerge�r r� r r r r r� 5 s z_Parser.ParseLinesc C s d| _ | �||� |S )zBMerges a text representation of a protocol message into a message.Tr� r� r r r r� ; s z_Parser.MergeLinesc C sF t jrdd� |D �}ndd� |D �}t|�}|�� sB| �||� q,dS )z�Converts a text representation of a protocol message into a message.
Args:
lines: Lines of a message's text representation.
message: A protocol buffer message to merge into.
Raises:
ParseError: On text parsing problems.
c s s& | ] }t |t�r|n|�d �V qdS �r1 N)r2 r r4 ��.0r r r r � <genexpr>M s �z(_Parser._ParseOrMerge.<locals>.<genexpr>c s s& | ] }t |t�r|n|�d �V qdS r� )r2 r �decoder� r r r r� P s �N)r* r+ � Tokenizer�AtEnd� _MergeField)r r� r Z str_lines� tokenizerr r r r� A s ��z_Parser._ParseOrMergec C sh |j }|jtkr�|�d�r�| �|�\}}|�d� |�d� |�d�rLd}n|�d� d}t|| j�}|svtd| ��|�|�s�|� � r�|�
d |f ��| � ||� qvd
}|j |||d � d S |�d��rl|�
� g} |�d
�r�| �|�
� � q�d
�| �} |j�s|�
d|j ��|j�| �}
|
�s@| j�r0d }
n|�
d| ��n ||
jk�r`|�
d| |jf ��|�d� n�|�� } | j�r�| �� �r�t| dd�} |j�| d �}
|
�s$|j�r$|j�| �}
nh|j �| d �}
|
�s�|j �| � � d �}
|
�r�|
j t j j!k�r�d }
|
�r$|
j t j j!k�r$|
j"j#| k�r$d }
|
�sF| j$�sF|�
d|j| f ��|
�r2| j%�s�|
j&�r�|�'|
j&j#�} | d u�r�| |
j#k�r�|�
d|
j#| |
j&j#|jf ��|
j(t j j)k�r�|�d� | j*}
n|�d� | j+}
|
j,t j j-k�r$|�d��r$|�d��s0|
|||
� |�d��r�q0|�d� �q�n |
|||
� n | j�sF| j$�sFJ �t.|� |�d��sd|�d� d S )z�Merges a single protocol message field into a message.
Args:
tokenizer: A tokenizer to parse the field name and values.
message: A protocol message to record the data.
Raises:
ParseError: In case of text parsing problems.
r� r� re r� r� r� r� z$Type %s not found in descriptor pool�Expected "%s".F)�type_url_prefix�
deterministicN�.z+Message type "%s" does not have extensions.z�Extension "%s" not registered. Did you import the _pb2 module which defines it? If you are trying to place the extension in the MessageSet field of another message that is in an Any or MessageSet field, that message's _pb2 module must be imported as wellz1Extension "%s" does not extend message type "%s".Tz*Message type "%s" has no field named "%s".zbField "%s" is specified along with field "%s", another member of oneof "%s" for message type "%s".�,�;)/rv rw rx �
TryConsume�_ConsumeAnyTypeUrl�Consumera rD r r� �ParseErrorPreviousTokenr� ZPack�ConsumeIdentifier�append�joinZ
is_extendable�
ExtensionsZ_FindExtensionByNamer� r� �ConsumeIdentifierOrNumberr� �isdigit� ParseIntegerZfields_by_numberrL Z_FindExtensionByNumber�fields_by_name�lowerrP r rQ r� rS r� r� r� Zcontaining_oneofZ
WhichOneofr~ r �_MergeMessageField�_MergeScalarFieldr| r} �_SkipFieldContents)r r� r r` r� Zpacked_type_nameZexpanded_any_end_tokenZexpanded_any_sub_messager� r� rU rp Z which_oneofZmergerr r r r� V s�
�
��
��
�� �� ��
��� ���
� z_Parser._MergeFieldc C s| |� � g}|�d� |�|� � � |�d� |�|� � � |�d� |� � g}|�d�rh|�|� � � qNd�|�d�|�fS )zBConsumes a google.protobuf.Any type URL and returns the type name.r� rd )r� r� r� r� r� )r r� �prefixr� r r r r� � s
z_Parser._ConsumeAnyTypeUrlc C sz t |�}|�d�rd}n|�d� d}|jtjjkrt|jrJ|j| � � }q�|rbt
||j �� � � }q�t
||j �� � }nx|jr�| j
s�|�|�r�|�d|jj|jf ��|j| }n6| j
s�|�|j �r�|�d|jj|j f ��t
||j �}|�� |�|��s |�� �r|�d|f ��| �||� q�|�rv|jjd j}|tjjk�rbt
||j �|j }|�|j � n|j t
||j �|j< d S )
a" Merges a single scalar field into a message.
Args:
tokenizer: A tokenizer to parse the field value.
message: The message of which field is a member.
field: The descriptor of the field to be merged.
Raises:
ParseError: In case of text parsing problems.
r� r� r� r� �;Message type "%s" should not have multiple "%s" extensions.�7Message type "%s" should not have multiple "%s" fields.r� r[ N) rV r� r� r| r rQ r} ro r� �add�getattrr� r{ r� � HasExtensionr� rv rw �HasFieldZ SetInParentr� r� rS r� r~ r ru Z MergeFromr[ ) r r� r rU Z is_map_entryZ end_tokenZ sub_messageZ
value_cpptyper[ r r r r� � sR
� ��
� ��
z_Parser._MergeMessageFieldc C s | j }t|d�o|jdkS )N�syntax�proto3)rv �hasattrr� )r r` r r r �_IsProto3Syntax( s
�z_Parser._IsProto3Syntaxc C s | j }d}|jtjjtjjtjjfv r0t|�}n�|jtjjtjj tjj
fv rVt |�}n�|jtjj tjj
fv rvt|�}n�|jtjjtjjfv r�t|�}n�|jtjjtjjfv r�|�� }nr|jtjjkr�|�� }nZ|jtjjkr�|�� }nB|jtjjkr�|�� }n*|jtjjk�r|� |�}nt d|j ��|j tjj k�rf|j �rR|j!| �"|� nt#||j$��"|� n�|j �r�| j%�s�| �&|��s�|�'|��r�|�(d|j)j*|j*f ��n
||j!|< ndd}| j%�s�| �&|��r�t+t#||j$��}n |�,|j$�}|�r
|�(d|j)j*|j$f ��nt-||j$|� dS )aH Merges a single scalar field into a message.
Args:
tokenizer: A tokenizer to parse the field value.
message: A protocol message to record the data.
field: The descriptor of the field to be merged.
Raises:
ParseError: In case of text parsing problems.
RuntimeError: On runtime errors.
NzUnknown field type %dr� Fr� ).r� rP r rQ Z
TYPE_INT32Z TYPE_SINT32Z
TYPE_SFIXED32�
_ConsumeInt32Z
TYPE_INT64Z TYPE_SINT64Z
TYPE_SFIXED64�
_ConsumeInt64Z TYPE_UINT32Z TYPE_FIXED32�_ConsumeUint32Z TYPE_UINT64Z TYPE_FIXED64�_ConsumeUint64Z
TYPE_FLOATZ TYPE_DOUBLE� ConsumeFloatZ TYPE_BOOL� ConsumeBoolZ TYPE_STRING�
ConsumeStringr� �ConsumeByteStringZ TYPE_ENUM� ConsumeEnum� RuntimeErrorr| r} ro r� r� r� r� r� r� r� r� rv rw �boolr� �setattr)r r� r rU �_r[ Zduplicate_errorr r r r� . sz
�
�
�
�
�
�� �� ��z_Parser._MergeScalarField)FFNF)r r r r r r� r� r� r� r� r� � staticmethodr� r� r r r r r� ( s �
:
r� c C s4 | � d�r(| �d�s(| �d�s(t| � nt| � dS )z}Skips over contents (value or message) of a field.
Args:
tokenizer: A tokenizer to parse the field name and values.
re r� r� N)r� � LookingAt�_SkipFieldValue�_SkipFieldMessage�r� r r r r� z s ��
r� c C sZ | � d�r2| �� | � d�r&| �� q| �d� n| �� t| � | � d�sV| � d� dS )z�Skips over a complete field (name and value/message).
Args:
tokenizer: A tokenizer to parse the field name and values.
r� r� r� r� r� N)r� r� r� r� r� r� r r r �
_SkipField� s
r� c C sJ | � d�rd}n| �d� d}| �d�s<| �d�s<t| � q | �|� dS )zfSkips over a field message.
Args:
tokenizer: A tokenizer to parse the field name and values.
r� r� r� r� N)r� r� r� r� )r� Z delimiterr r r r� � s
r� c C sH | � � r| � � rqdS | �� sDt| �sDt| �sD| �� sDtd| j ��dS )z�Skips over a field value.
Args:
tokenizer: A tokenizer to parse the field name and values.
Raises:
ParseError: In case an invalid field value is found.
NzInvalid field value: )�TryConsumeByteString�TryConsumeIdentifier�_TryConsumeInt64�_TryConsumeUint64�TryConsumeFloatr �tokenr� r r r r� � s ���r� c @ sH e Zd ZdZe�d�Ze�dej�Ze�dej�Z e�d�
ddgdd � e D � ��Z e�d
�Z
e�d �ZdEd
d�Zdd� Zdd� Zdd� Zdd� Zdd� Zdd� Zdd � Zd d � Zd d � Zd!d"� Zd#d$� Zd%d&� Zd'd(� Z dFd*d+�Z d,d-� Z d.d/� Z d0d1� Z d2d3� Z!d4d5� Z"d6d7� Z#d8d9� Z$d:d;� Z%d<d=� Z&d>d?� Z'd@dA� Z(dBdC� Z)dDS )Gr� z�Protocol buffer text representation tokenizer.
This class handles the lower level string parsing by splitting it into
meaningful tokens.
It was directly ported from the Java protocol buffer API.
z\s+z (\s*#.*$)z (\s|(#.*$))+�|z[a-zA-Z_][0-9a-zA-Z_+-]*z#([0-9+-]|(\.[0-9]))[0-9a-zA-Z_.+-]*c C s g | ]}d j |d��qS )z0{qt}[^{qt}\n\\]*((\\.)+[^{qt}\n\\]*)*({qt}|\\?$))Zqt)r )r� Zmarkr r r �
<listcomp>� s �zTokenizer.<listcomp>z
[^\d\W]\w*z\w+Tc C sl d| _ d| _d| _d | _d| _t|�| _d| _d| _d| _ d| _
|| _ |rP| j pT| j
| _| �� | �� d S )Nr r� rf T)Z _positionr r Z _token_startr� �iter�_lines�
_current_line�_previous_line�_previous_column� _more_lines�_skip_comments�_WHITESPACE_OR_COMMENT� _WHITESPACE�_whitespace_pattern�_SkipWhitespace� NextToken)r r� Z
skip_commentsr r r r � s
�zTokenizer.__init__c C s
| j |kS r$ �r� �r r� r r r r� � s zTokenizer.LookingAtc C s | j S )z^Checks the end of the text was reached.
Returns:
True iff the end was reached.
r r% r r r r� � s zTokenizer.AtEndc C s\ t | j�| jkrXzt| j�| _W n ty@ d| _d| _Y d S 0 | jd7 _d| _q d S )Nrf Fr� r )r� r� r �nextr� �
StopIterationr� r r% r r r �_PopLine s zTokenizer._PopLinec C sB | � � | j�| j| j�}|s q>t|�d��}| j|7 _q d S rn )r r �matchr� r r� �group)r r �lengthr r r r
s zTokenizer._SkipWhitespacec C s | j |kr| �� dS dS )z�Tries to consume a given piece of text.
Args:
token: Text to consume.
Returns:
True iff the text was consumed.
TF)r� r r r r r r� s
zTokenizer.TryConsumec C s | � |�s| �d| ��dS )z�Consumes a piece of text.
Args:
token: Text to consume.
Raises:
ParseError: If the text couldn't be consumed.
r� N)r� r r r r r r� $ s
zTokenizer.Consumec C s( | j }| j�|�s | �d��| �� |S )NzExpected comment.)r� �_COMMENTr r r �r rI r r r �ConsumeComment0 s
zTokenizer.ConsumeCommentc C s: | j dko| jdk}| j}| �� }| j|ko0| }||fS )zCConsumes a comment, returns a 2-tuple (trailing bool, comment str).r )r r r� r )r Z just_startedZbefore_parsingZcommentZtrailingr r r � ConsumeCommentOrTrailingComment7 s
�z)Tokenizer.ConsumeCommentOrTrailingCommentc C s( z| � � W dS ty" Y dS 0 d S �NTF)r� r r% r r r r� G s
z Tokenizer.TryConsumeIdentifierc C s( | j }| j�|�s | �d��| �� |S )��Consumes protocol message field identifier.
Returns:
Identifier string.
Raises:
ParseError: If an identifier couldn't be consumed.
zExpected identifier.)r� � _IDENTIFIERr r r r
r r r r� N s
zTokenizer.ConsumeIdentifierc C s( z| � � W dS ty" Y dS 0 d S r )r� r r% r r r � TryConsumeIdentifierOrNumber] s
z&Tokenizer.TryConsumeIdentifierOrNumberc C s, | j }| j�|�s | �d| ��| �� |S )r z&Expected identifier or number, got %s.)r� �_IDENTIFIER_OR_NUMBERr r r r
r r r r� d s
z#Tokenizer.ConsumeIdentifierOrNumberc C s( z| � � W dS ty" Y dS 0 d S r )�ConsumeIntegerr r% r r r �TryConsumeIntegers s
zTokenizer.TryConsumeIntegerFc
C sR zt | j|d�}W n2 tyD } z| �t|���W Y d}~n
d}~0 0 | �� |S )z�Consumes an integer number.
Args:
is_long: True if the value should be returned as a long integer.
Returns:
The integer parsed.
Raises:
ParseError: If an integer couldn't be consumed.
��is_longN)�_ParseAbstractIntegerr� �
ValueErrorr r r )r r rI �er r r r { s $zTokenizer.ConsumeIntegerc C s( z| � � W dS ty" Y dS 0 d S r )r� r r% r r r r� � s
zTokenizer.TryConsumeFloatc
C sN zt | j�}W n2 ty@ } z| �t|���W Y d}~n
d}~0 0 | �� |S )z�Consumes an floating point number.
Returns:
The number parsed.
Raises:
ParseError: If a floating point number couldn't be consumed.
N)�
ParseFloatr� r r r r �r rI r r r r r� � s $zTokenizer.ConsumeFloatc
C sN zt | j�}W n2 ty@ } z| �t|���W Y d}~n
d}~0 0 | �� |S )z�Consumes a boolean value.
Returns:
The bool parsed.
Raises:
ParseError: If a boolean value couldn't be consumed.
N)� ParseBoolr� r r r r r r r r r� � s $zTokenizer.ConsumeBoolc C s( z| � � W dS ty" Y dS 0 d S r )r� r r% r r r r� � s
z Tokenizer.TryConsumeByteStringc
C sJ | � � }zt�|d�W S tyD } z| �|��W Y d}~n
d}~0 0 dS )z�Consumes a string value.
Returns:
The string parsed.
Raises:
ParseError: If a string value couldn't be consumed.
r1 N)r� r* r3 �UnicodeDecodeError�_StringParseError)r Z the_bytesr r r r r� � s
zTokenizer.ConsumeStringc C s8 | � � g}| jr.| jd tv r.|�| � � � q
d�|�S )z�Consumes a byte array value.
Returns:
The array parsed (as a string).
Raises:
ParseError: If a byte array value couldn't be consumed.
r rt )�_ConsumeSingleByteStringr� �_QUOTESr� r� )r Zthe_listr r r r� � s
zTokenizer.ConsumeByteStringc
C s� | j }t|�dk s |d tvr.| �d|f ��t|�dk sJ|d |d krZ| �d|f ��zt�|dd� �}W n2 ty� } z| �t|���W Y d}~n
d}~0 0 | �� |S )aO Consume one token of a string literal.
String literals (whether bytes or text) can come in multiple adjacent
tokens which are automatically concatenated, like in C or Python. This
method only consumes one token.
Returns:
The token parsed.
Raises:
ParseError: When the wrong format data is found.
r� r z Expected string but found: %rrb r� z String missing ending quote: %rN) r� r� r" r r Z CUnescaper r r )r rN rI r r r r r! � s $z"Tokenizer._ConsumeSingleByteStringc
C sP zt || j�}W n2 tyB } z| �t|���W Y d }~n
d }~0 0 | �� |S r$ )� ParseEnumr� r r r r )r rU rI r r r r r� � s $zTokenizer.ConsumeEnumc C s t || jd | jd �S )z�Creates and *returns* a ParseError for the previously read token.
Args:
message: A message to set for the exception.
Returns:
A ParseError instance.
r� )r r� r� �r r r r r r� � s �z!Tokenizer.ParseErrorPreviousTokenc C s& t d| j d | | jd | jd �S )z9Creates and *returns* a ParseError for the current token.r
z': r� )r r� r r r$ r r r r s �zTokenizer.ParseErrorc C s | � dt|� �S )NzCouldn't parse string: )r r )r r r r r r s zTokenizer._StringParseErrorc C s� | j | _| j| _| jt| j�7 _| �� | js<d| _dS | j� | j
| j�}|sj| j sj| j � | j
| j�}|r�|�
d�}|| _n| j
| j | _dS )z Reads the next meaningful token.rf Nr )r r� r r� r� r� r r� �_TOKENr r� r� r r
)r r r� r r r r s
zTokenizer.NextTokenN)T)F)*r r r r �re�compiler � MULTILINEr r� r� r" r% r r r r� r� r r r� r� r r r� r� r r� r r r� r� r� r� r� r� r! r� r� r r r r r r r r� � sR
���
r� c C s t | ddd�S )��Consumes a signed 32bit integer number from tokenizer.
Args:
tokenizer: A tokenizer used to parse the number.
Returns:
The integer parsed.
Raises:
ParseError: If a signed 32bit integer couldn't be consumed.
TF�� is_signedr ��_ConsumeIntegerr� r r r r� ( s r� c C s t | ddd�S )z�Consumes an unsigned 32bit integer number from tokenizer.
Args:
tokenizer: A tokenizer used to parse the number.
Returns:
The integer parsed.
Raises:
ParseError: If an unsigned 32bit integer couldn't be consumed.
Fr* r, r� r r r r� 7 s r� c C s( zt | � W dS ty" Y dS 0 d S r )r� r r� r r r r� F s
r� c C s t | ddd�S )r) Tr* r, r� r r r r� N s r� c C s( zt | � W dS ty" Y dS 0 d S r )r� r r� r r r r� ] s
r� c C s t | ddd�S )z�Consumes an unsigned 64bit integer number from tokenizer.
Args:
tokenizer: A tokenizer used to parse the number.
Returns:
The integer parsed.
Raises:
ParseError: If an unsigned 64bit integer couldn't be consumed.
FTr* r, r� r r r r� e s r� c C s. zt | ||d� W dS ty( Y dS 0 d S )Nr* TF)r- r )r� r+ r r r r �_TryConsumeIntegert s
r. c
C sT zt | j||d�}W n2 tyF } z| �t|���W Y d}~n
d}~0 0 | �� |S )aU Consumes an integer number from tokenizer.
Args:
tokenizer: A tokenizer used to parse the number.
is_signed: True if a signed integer must be parsed.
is_long: True if a long integer must be parsed.
Returns:
The integer parsed.
Raises:
ParseError: If an integer with given characteristics couldn't be consumed.
r* N)r� r� r r r r )r� r+ r rI r r r r r- | s $r- c C s2 t | |d�}tdt|� t|� }|�|� |S )a Parses an integer.
Args:
text: The text to parse.
is_signed: True if a signed integer must be parsed.
is_long: True if a long integer must be parsed.
Returns:
The integer value.
Raises:
ValueError: Thrown Iff the text is not a valid integer.
r rb )r �_INTEGER_CHECKERS�intZ
CheckValue)rN r+ r rI Zcheckerr r r r� � s
r� c C sp | }t �d| �}|r,|�d�d |�d� } z |r>t| d�W S t| d�W S W n tyj td| ��Y n0 dS )a Parses an integer without checking size/signedness.
Args:
text: The text to parse.
is_long: True if the value should be returned as a long integer.
Returns:
The integer value.
Raises:
ValueError: Thrown Iff the text is not a valid integer.
z (-?)0(\d+)$r� Z0orb r zCouldn't parse integer: %sN)r& r r
�longr0 r )rN r Z orig_textZ
c_octal_matchr r r r � s r c C s� z
t | �W S ty� t�| �rH| d dkr:t d� Y S t d� Y S nJt�| �r^t d� Y S zt | �d��W Y S ty� td| ��Y n0 Y n0 dS ) z�Parse a floating point number.
Args:
text: Text to parse.
Returns:
The number parsed.
Raises:
ValueError: If a floating point number couldn't be parsed.
r �-z-inf�inf�nan�fzCouldn't parse float: %sN)�floatr �_FLOAT_INFINITYr �
_FLOAT_NANr< �rN r r r r � s
r c C s$ | dv r dS | dv rdS t d��dS )z�Parse a boolean value.
Args:
text: Text to parse.
Returns:
Boolean values parsed
Raises:
ValueError: If text is not a valid boolean.
)r� �t�1�TrueT)r� r5 �0�FalseFzExpected "true" or "false".N)r r9 r r r r � s
r c C s� | j }zt|d�}W n: tyN |j�|d�}|du rJtd|j|f ��Y nF0 t| jd�rl| jjdkrl|S |j �|d�}|du r�td|j|f ��|j
S )a& Parse an enum value.
The value can be specified by a number (the enum value), or by
a string literal (the enum name).
Args:
field: Enum field descriptor.
value: String value.
Returns:
Enum value number.
Raises:
ValueError: If the enum value could not be parsed.
r Nz%Enum type "%s" has no value named %s.r� r� z+Enum type "%s" has no value with number %d.) r� r0 r Zvalues_by_namerL rw r� �filer� r� rp )rU r[ Zenum_descriptorrp r� r r r r# � s$ � �r# )
FFFFFNNFNr NFF)
r FFFFFNNFNNFF) r FFFFFNNNFF) r FFFFFNNNFF)FFNF)FFNF)FFNF)FFNF)FF)FF)FF)F)Fr �
__author__Z encodings.raw_unicode_escape� encodingsZencodings.unicode_escaper, r� r& r* Zgoogle.protobuf.internalr r r] r r ZPY3r0 r1 �__all__ZUint32ValueCheckerZInt32ValueCheckerZUint64ValueCheckerZInt64ValueCheckerr/ r' �
IGNORECASEr7 r8 � frozensetr" rx r� r r �objectr) r r rV r r r
ra r� r� r; r r r� r� r� r� r� r� r� r� Z
_Tokenizerr� r� r� r� r� r� r. r- r� r r r r# r r r r �<module> s � �
R
�
" �
�
> �
< �
( �
$ �
" T Z