File: //opt/alt/python37/lib/python3.7/site-packages/xray/internal/__pycache__/utils.cpython-37.pyc
B
�*Ud�[ � @ s� d Z ddlZddlZddlZddlZddlZddlZddlZddlZddl Z ddl
m m Z
ddlmZ ddlmZmZ ddlmZ ddlmZ ddlmZmZmZmZmZmZm Z ddl m Z dd l m Z m!Z!m"Z" ddl#Z#dd
l$m%Z% dd l&m'Z' dd l(m)Z) dd
l*m+Z+ ddl,m-Z-m.Z.m/Z/ ddl0m1Z1 ddl2m3Z3 ddl4m5Z5 ddl6m7Z7m8Z8m9Z9m:Z:m;Z;m<Z< ddl=m>Z> e�?d�Z@eAeBejCfZDe.jEjFe.jGjFe.jHjFgZIe e d�dd�ZJe e d�dd�ZKe e d�dd �ZLeMd �d d �ZNed �d d!�ZOeMed"�d#d$�ZPeQd �d%d&�ZRe!eS eQd'�d(d)�ZTe!eS eQd'�d*d+�ZUeQd �d,d-�ZVeQdd.�d/d0�ZWeQd �d1d2�ZXdreQe"eY d3�d4d5�ZZeLeQd �d6d7��Z[dd �d8d9�Z\eQe"eQ d:�d;d<�Z]eQeQdd=�d>d?�Z^eQd@dA�dBdC�Z_eMeMdD�dEdF�Z`eQe"ea dG�dHdI�ZbeQe"eQ dG�dJdK�ZcdseQddG�dLdM�ZdeQeYdG�dNdO�ZeeYd �dPdQ�ZfeYd �dRdS�ZgeYddT�dUdV�ZheYd �dWdX�ZieYd �dYdZ�ZjeYd �d[d\�ZkeQeYd]�d^d_�Zld`da� Zmedbddc�ddde��ZnedteQeYdg�dhdi��ZoedueMddj�dkdl��ZpedveMeMeMddo�dpdq��ZqdS )wzB
This module contains helpful utility functions for X-Ray Manager
� N)�contextmanager)�date� timedelta)�wraps)�glob)�socket�fromfd�AF_UNIX� SOCK_STREAM�
SOCK_DGRAM�AF_INET�AF_INET6)�current_thread)�Callable�List�Optional)�AtexitIntegration)�LoggingIntegration)�Feature)�is_panel_feature_supported)�
CLEditions�SupportedEditions�CLEditionDetectionError)�UIConfig)�drop_privileges)�php_get_vhost_versions_user� )�
sentry_dsn�local_tasks_storage�
agent_file�
logging_level�jwt_token_location�user_agent_sock)� XRayErrorZutils)�func�returnc s" dd� �t � �� �fdd��}|S )zf
Decorator aimed to update ini file in cagefs-skeleton
Applies to task.add nd task.remove
c
W s< t j�| d jd�}|�d�r>td�r>t j�d|dd� �}nT|�d�r�td �r�t j�d |dd� �}t j�t j�|��s�t �t j�|�� ndS t j�|�s�yt � |� W n: t
k
r� } z t j d
|t
|�d �d � W dd}~X Y nX nNyt�||� W n< t
k
�r6 } z t j d
|t
|�d �d � W dd}~X Y nX dS )zd
Copy ini file to cagefs-skeleton
Action takes place for cPanel ea-php only
r zxray.iniz /opt/cpanelz/usr/share/cagefsz"/usr/share/cagefs/.cpanel.multiphpr Nz
/usr/localz/usr/share/cagefs-skeletonz'Failed to unlink ini in cagefs-skeleton)Zxray_ini�err)�extraz'Failed to copy ini into cagefs-skeleton)�os�path�joinZ ini_location�
startswithr �exists�dirname�mkdir�unlink�OSError�logger�warning�str�shutil�copy)�argsZ original_iniZ skeleton_ini�e� r8 �D/opt/alt/python37/lib/python3.7/site-packages/xray/internal/utils.py�updateM s2 $z skeleton_update.<locals>.updatec s � | |� �| � dS )z
Wraps func
Nr8 )r6 �kwargs)r$ r: r8 r9 �wrappero s
z skeleton_update.<locals>.wrapper)r )r$ r< r8 )r$ r: r9 �skeleton_updateG s "r= c s, dd� �dd� �t � �� ��fdd��}|S )zs
Decorator aimed to update DBM storage with fake_id:real_id mapping
Applies to task.add nd task.remove
c W s, | d }t t��}|j||j< W dQ R X dS )z-
Update DBM storage contents
r N)� dbm_storager Ztask_id�fake_id)r6 Z
task_instance� task_storager8 r8 r9 r: � s
z"dbm_storage_update.<locals>.updatec W sB t t��0}y|| d j�� = W n tk
r2 Y nX W dQ R X dS )z.
Remove task from DBM storage
r N)r> r r? �encode�KeyError)r6 r@ r8 r8 r9 �remove� s
z"dbm_storage_update.<locals>.removec
s� y� j dkr�| � W n. tk
rD } ztt|���W dd}~X Y nX y� | |� W n( tk
r| � j dkrv�| � � Y nX y� j dkr��| � W n. tk
r� } ztt|���W dd}~X Y nX dS )z
Wraps func
�addNrC )�__name__� RuntimeErrorr# r3 � Exception)r6 r; r7 )r$ rC r: r8 r9 r< � s
z#dbm_storage_update.<locals>.wrapper)r )r$ r< r8 )r$ rC r: r9 �dbm_storage_updatez s rH c s" dd� � t ��� �fdd��}|S )z5
Decorator aimed to validate given JWT token
c S s t | � dS )z7
Check if retrieved JWT token is valid
N)�is_edition_supported)�_tokenr8 r8 r9 �check� s zcheck_jwt.<locals>.checkc s �| |�}� |� |S )z
Wraps func
r8 )r6 r; �token)rK r$ r8 r9 r< � s
zcheck_jwt.<locals>.wrapper)r )r$ r< r8 )rK r$ r9 � check_jwt� s rM )r% c C s t t�� �S )zJ
Get current epoch timestamp as int
:return: timestamp as int
)�int�timer8 r8 r8 r9 � timestamp� s rP c C s t �� tdd� S )zC
Pick a yesterday date
:return: a datetime.date object
r )Zdays)r Ztodayr r8 r8 r8 r9 � prev_date� s rQ )�tsr% c C s
t �| �S )zy
Get the datetime.date object for given int timestamp
:param ts: timestamp
:return: datetime.date object
)r Z
fromtimestamp)rR r8 r8 r9 �date_of_timestamp� s rS c C s t � �d�S )zj
Get a formatted representation of yesterday date
:return: str date in the form of dd/mm/YYYY
z%d/%m/%Y)rQ �strftimer8 r8 r8 r9 �get_formatted_date� s rU )�linksr% c s" d� d� � fdd�t| d�D ��S )z
HTML formatted links
z)<p>{num}) <a href={link}>{domain}</a></p>�
c s2 g | ]*\}}|� � D ]\}}� j|||d ��qqS ))�num�link�domain)�items�format)�.0�i�l�k�v)� html_itemr8 r9 �
<listcomp>� s z,get_html_formatted_links.<locals>.<listcomp>r )r* � enumerate)rV r8 )rb r9 �get_html_formatted_links� s re c s" d� d� � fdd�t| d�D ��S )z
Formatted links
z{num}) {dom}: {link}rW c s2 g | ]*\}}|� � D ]\}}� j|||d ��qqS ))rX ZdomrY )r[ r\ )r] r^ r_ r` ra )� text_itemr8 r9 rc � s z,get_text_formatted_links.<locals>.<listcomp>r )r* rd )rV r8 )rf r9 �get_text_formatted_links� s rg c
C s� yHt �d�} | �� }|�d�j}t�� �}|�d|� W dQ R X |�d�S t t j
fk
rz } zt d�|�W dd}~X Y nX dS )ze
Obtain system ID from /etc/sysconfig/rhn/systemid
:return: system ID without ID- prefix
z/etc/sysconfig/rhn/systemidz(.//member[name='system_id']/value/string� system_idNzID-z Failed to retrieve system_id) �ET�parseZgetroot�find�text�
sentry_sdk�configure_scopeZset_tag�lstripr0 Z
ParseErrorr# )Ztree�rootZwhole_id�scoper7 r8 r8 r9 � read_sys_id� s
rr )�sys_idr% c C s$ t td��}|�| � W dQ R X dS )zH
Write system_id into file /usr/share/alt-php-xray/agent_sys_id
�wN)�openr �write)rs �outr8 r8 r9 � write_sys_id s rx c
C s` y t t��} | �� �� S Q R X W n: tk
rZ } z tjddt|�id� t� S d}~X Y nX dS )zA
Read system_id saved by agent during its initialization
Nz8Failed to retrieve agent's system_id, returning real oner& )r' ) ru r �read�stripr0 r1 �errorr3 rr )Zagent_sysid_filer7 r8 r8 r9 �read_agent_sys_id s
r| )rJ r% c
C sf yt j| dd�}W n. tk
r@ } zt|j�|�W dd}~X Y nX |tkrbtdt|��� � d���dS )z9Raise XRayError in case of detected non-supported editionT)Zraw_jwtZskip_marker_checkNzCL z" edition is not supported by X-Ray)r Zget_cl_editionr r# �message�SUPPORTED_EDITIONSr3 �
capitalize)rJ Zeditionr7 r8 r8 r9 rI & s rI c C sN y t t��} | �� �� S Q R X W n( ttfk
rH tdt� d���Y nX dS )zT
Obtain jwt token from /etc/sysconfig/rhn/jwt.token
:return: token read
Nz JWT file z read error)ru r! ry rz r0 �IOErrorr# )Z
token_filer8 r8 r9 �read_jwt_token3 s
r� c s� t t t d�dd�} dd�dd�}dd � � td�� fd
d � }ttjtjd �}t|d
�}tjt | d||gd� t�
� �}d|� i|_ W dQ R X dS )u�
Initialize Sentry client
shutdown_timeout=0 disables Atexit integration as stated in docs:
'it’s easier to disable it by setting the shutdown_timeout to 0'
https://docs.sentry.io/platforms/python/default-integrations/#atexit
On the other hand, docs say, that
'Setting this value too low will most likely cause problems
for sending events from command line applications'
https://docs.sentry.io/error-reporting/configuration/?platform=python#shutdown-timeout
)�event�hintr% c S s | d � ddi� | S )z�
Add extra data into sentry event
:param event: original event
:param hint: additional data caught
:return: updated event
r' z xray.versionz
0.5-17.el9)r: )r� r� r8 r8 r9 �add_infoL s z sentry_init.<locals>.add_infoN)r% c S s d S )Nr8 )�pending�timeoutr8 r8 r9 �nopeV s zsentry_init.<locals>.nopec S sR t | t��>}y |�|df� |�� d }W n tk
rB d}Y nX W dQ R X |S )aI
address_family - we can choose constants represent the address
(and protocol) families
(AF_INET for ipv4 and AF_INET6 for ipv6)
private_ip - specify some private ip address. For instance:
ipv4 -> 10.255.255.255 or ipv6 -> fc00::
r r N)r r �connectZ getsocknamerG )Zaddress_familyZ
private_ip�s�IPr8 r8 r9 �
try_get_ipY s z sentry_init.<locals>.try_get_ipc s8 t dftdff} x"| D ]\}}� ||�}|r|S qW dS )z&
Retrieve server's IP
z10.255.255.255zfc00::z 127.0.0.1)r r
)Z
ipversionsZaddr_famZpriv_ipZip)r� r8 r9 �ip_addri s
z sentry_init.<locals>.ip_addr)�levelZ event_level)�callbackzalt-php-xray@0.5-17.el9)ZdsnZ before_send�releaseZ integrationsZ
ip_address) �dictr3 r �logging�INFO�WARNINGr rm Zinitr rn �user)r� r� r� Zsentry_loggingZ
silent_atexitrq r8 )r� r9 � sentry_init@ s
r� )�lognamer% c C s� t jt jt jt jt jd�}t� y t j| |�t t j�ddd� W n& t
k
rf t jt � � gd� dS X yt �
| d� W n tk
r� Y nX | S )z[
Configure logging and Sentry
:param logname: path to log
:return: logpath
)�debug�infor2 r{ �criticalz%(asctime)s %(message)sz%m/%d/%Y %I:%M:%S %p)�filenamer� r\ �datefmt)�handlersNi� )r� �DEBUGr� r� �ERROR�CRITICALr� � basicConfig�getr r0 � NullHandlerr( �chmod�PermissionError)r� Zlevelsr8 r8 r9 �configure_logging~ s&
r� )�src�dstr% c C sX yt �| |� W nB tk
rR } z$td| � d|� dt|�� ��|�W dd}~X Y nX dS )zZ
Move file with error catching
:param src: source
:param dst: destination
zFailed to move file z to z: N)r4 Zmover0 r# r3 )r� r� r7 r8 r8 r9 � safe_move� s r� z
socket object)�
sock_locationr% c C s` t tj�dd��}|dkrHt� � tt�}|�| � |�� W dQ R X nt dtt
�}|�� |S )z�
Create world-writable socket in given sock_location
or reuse existing one
:param sock_location: socket address
:return: socket object
�
LISTEN_FDSr N� ) rN r( �environr� �umask_0r r ZbindZlistenr r
)r� r� Zsockobjr8 r8 r9 �
create_socket� s
r� )�lve_idr% c
C s� t tj�sdS d}d| � d�}y\t|��J}xB|D ]:}|�|�r0t�dt� j|� t |�
� � |�d �
� �S q0W W dQ R X W n4 t k
r� } zt�
d|t|�� W dd}~X Y nX dS ) zX
Retrieve current value of CPU throttled time.
Return 0 in case of failures
r Zthrottled_timez /sys/fs/cgroup/cpu,cpuacct/lvez /cpu.statz[%s] %s���NzFailed to open %s: %s)r r �LVEru r+ r1 r� r �namerN rz �splitr0 r{ r3 )r� ZmarkerZ stat_fileZ stat_values�valuer7 r8 r8 r9 � get_current_cpu_throttling_time� s
,$r� )�usernamer% c
C s� d}t j�|�sdS y.tj|d| dgdddd�}|j�� |j�� fS tjk
r| } zt j
ddt |�id � W dd}~X Y n2 t k
r� } zt �
d
t |�� W dd}~X Y nX dS ) z�
'selectorctl -u username --user-current' command
:param username: name of user
:return: tuple(stdout, stderr) or None if command fails
z/usr/bin/selectorctlNz-uz--user-currentT)�capture_outputrl rK z&Failed to get selectorctl user-currentr& )r' z%selectorctl --user-current failed: %s)r( r) �isfile�
subprocess�run�stdoutrz �stderr�CalledProcessErrorr1 r2 r3 �subprocess_errorsr{ )r� Z _selectorctl�resultr7 r8 r8 r9 �_selectorctl_get_version� s r� c
C s� d}t j�|�sdS y"tj|d| gdddd�}|j�� S tjk
rp } ztj ddt
|�id� W dd}~X Y n2 t k
r� } zt� d t
|�� W dd}~X Y nX dS )
z�
'cagefsctl --get-prefix username' command
:param username: name of user
:return: cagefsctl prefix for given username
or None if command fails
z/usr/sbin/cagefsctlNz --getprefixT)r� rl rK z Failed to get cagefsctl prefixr& )r' z cagefsctl --getprefix failed: %s)
r( r) r� r� r� r� rz r� r1 r2 r3 r� r{ )r� �
_cagefsctlr� r7 r8 r8 r9 �_cagefsctl_get_prefix� s
r� c
C s� d}t j�|�sdS | dkr(|ddg}n
|d| g}y tj|ddd� t�d| � W nj tjk
r� } ztjd d
t |�id � W dd}~X Y n2 t
k
r� } zt� d t |�� W dd}~X Y nX dS )
z�
'cagefsctl --remount username' or 'cagefsctl --remount-all' command
:param username: name of user or None (for remount-all)
z/usr/sbin/cagefsctlNz --wait-lockz
--remount-allz --remountT)rK r� z Remounted %szFailed to remount cagefsr& )r' z cagefsctl --remount failed: %s) r( r) r� r� r� r1 r� r� r2 r3 r� r{ )r� r� r6 r7 r8 r8 r9 �_cagefsctl_remount s
r� c
C sp d}t j�|�sdS y$tj|d| gddd�}d|j�� kS tk
rj } zt� dt
|�� W dd}~X Y nX dS ) z�
'cagefsctl --user-status username' command
:param username: name of user
:return: True if user has Enabled status, False otherwise
z/usr/sbin/cagefsctlFz
--user-statusT)r� rl ZEnabledz"cagefsctl --user-status failed: %sN) r( r) r� r� r� r� rz r� r1 r{ r3 )r� r� r� r7 r8 r8 r9 �_is_cagefs_enabled s
r� c C s> y t d��} | �� }W dQ R X W n tk
r4 dS X d|kS )z`
Check if there is php.d.location = selector
set in /etc/cl.selector/symlinks.rules
z /etc/cl.selector/symlinks.rulesNFZselector)ru ry r0 )Z
rules_file�contentsr8 r8 r9 � _is_selector_phpd_location_set, s
r� c C s$ t t��} t| �� �dkS Q R X dS )z:Check if there are no active tasks (== empty task storage)r N)r> r �len�keys)r@ r8 r8 r9 �no_active_tasks9 s
r� )�enabledr% c
C sx t tj�sdS y0tdddd��}|�| r,dnd� W dQ R X W n4 tk
rr } zt�d| t|�� W dd}~X Y nX dS ) zb
Switch on/off throttle statistics gathering by kmodlve
:param enabled: True or False
Nz!/proc/sys/kernel/sched_schedstats�wbr )�mode� buffering� 1� 0z(Failed to set sched_schedstats to %s: %s) r r r� ru rv r0 r1 r� r3 )r� �fr7 r8 r8 r9 �switch_schedstats? s
r� c C s t � �dd�dkS )zG
Check if end-users have access to X-Ray UI of End-User plugin
Z hideXrayAppZ
uiSettingsF)r Z get_paramr8 r8 r8 r9 �is_xray_app_availableQ s r� c
C sB t tt��.} y| �t� W n ttfk
r2 dS X W dQ R X dS )z Check if User Agent is listeningFNT)r r r
r� r" �ConnectionErrorr0 )r� r8 r8 r9 �is_xray_user_agent_activeX s r� c C s t j�d� S )z2Check if SSA is disabled by its internal flag-filez /usr/share/clos_ssa/ssa_enabled)r( r) r� r8 r8 r8 r9 � ssa_disabledb s r� )�filepathr% c C s0 yt � t�| �j dk S tk
r* dS X dS )z.Check is file was modified during the last dayi�Q FN)rP r( �stat�st_mtimer0 )r� r8 r8 r9 �is_file_recently_modifiedg s r� c C s t | �� t� }W d Q R X |S )N)r r )r� r� r8 r8 r9 �get_user_php_versionp s
r� z'file object providing a fileno() method)�fdr% c c s� x�t d�D ]z}y$t�| tjtjB � t�d� P W q
tk
r� } z2t�dt|�� |j t j
t j fkrh� t �
d� W dd}~X Y q
X q
W tddd��dV t�| tj� dS ) uq
Context manager for locking given file object
:param fd: а file object providing a fileno() method
�x z File lockedzFailed to lock: %sg �?Nz%Failed to lock at all. Exiting threadr2 )�flag)�range�fcntlZflockZLOCK_EXZLOCK_NBr1 r� r0 r3 �errnoZEAGAINZEACCESrO �sleepr# ZLOCK_UN)r� �_r7 r8 r8 r9 �filelockx s
r� F)r� � is_shelvec c s� t j�| �}d}x�td�D ]v}y.|r0t�| �}n t�| d�}t�d|� P W q tj k
r� } z"t�d|||� |}t
� d� W dd}~X Y qX qW t d|� d|� ���|V |�
� t�d |� dS )
a1
Context manager for waiting for lock to be released for DBM file storage,
either plain DBM or a Shelf object
(desired return value is controlled by _shelve_instance flag)
:param filename: a DBM file to open
:param is_shelve: if a shelve file should be opened instead of plain DBM
N�d �czStorage %s openedz#[#%i] Failed to open storage %s: %sg333333�?zFailed to open z
storage: zStorage %s closed)r( r) �basenamer� �shelveru �dbmr1 r� r{ rO r� rF �close)r� r� Z_fileZ_errr� Zstorager7 r8 r8 r9 r> � s& r> )�maskr% c c s t �| �}dV t �|� dS )z,
Context manager for dropping umask
N)r( �umask)r� �prevr8 r8 r9 r� � s
r� �.T)�
target_uid�
target_gidr� r% c c sd t �� }t �� }yt �|�}W n tk
r6 d}Y nX | dkrT|dkrN|} n|j} |dkrp|dkrj|}n|j}|dk r�t �|�}||kr�t �|� t �
d|� |r�t � � |kr�t d��|| k�rt �
| � t �
d| � |�rt �� | k�r||kr�t �|� t d��dV || k�r,t �
|� t �
d|� ||k�rLt �|� t �
d|� |dk �r`t �|� dS )aH
Context manager to drop privileges during some operation
and then restore them back.
If target_uid or target_gid are given, use input values.
Otherwise, stat target_uid and target_gid from given target_path.
If no target_path given, use current directory.
Use mask if given.
:param target_uid: uid to set
:param target_gid: gid to set
:param target_path: directory or file to stat for privileges,
default -- current directory
:param mask: umask to use
:param with_check: check the result of switching privileges
NzDropped GID privs to %sz6Unable to execute required operation: permission issuezDropped UID privs to %szRestored UID privs to %szRestored GID privs to %s)r( �getuid�getgidr� r0 �st_uid�st_gidr� �setegidr1 r� �getegidr# �seteuid�geteuid) r� r� Z target_pathr� Z
with_checkZprev_uidZprev_gid� stat_infor� r8 r8 r9 �set_privileges� sN
r� )N)N)F)r )NNr� NT)r�__doc__r� r� r� r� r( r� r4 r� rO Zxml.etree.ElementTreeZetreeZ ElementTreeri Z
contextlibr Zdatetimer r � functoolsr r r r r r
r r r
� threadingr �typingr r r rm Z sentry_sdk.integrations.atexitr Z sentry_sdk.integrations.loggingr Zclcommon.constr Zclcommon.cpapir Zclcommon.lib.cleditionr r r Zclcommon.ui_configr Zclcommon.clpwdr Z clwpos.papir Z constantsr r r r r! r" Z
exceptionsr# � getLoggerr1 r0 �
ValueErrorZSubprocessErrorr� Z
SHARED_PROr� ZSOLOZADMINr~ r= rH rM rN rP rQ rS r3 rU r� re rg rr rx r| �boolrI r� r� r� r� r� r� �tupler� r� r� r� r� r� r� r� r� r� r� r� r� r> r� r� r8 r8 r8 r9 �<module>
s� $
38
>