File: //var/opt/nydus/ops/primordial/__pycache__/zookeeper.cpython-39.pyc
a
�,�h�5 � @ s� d Z ddlZddlZddlmZ ddlmZmZ ddlm Z ddl
m Z ddl m
Z
ddlmZ dd lmZ dd
lmZ d Zefeed �d
d�ZG dd� d�ZG dd� de�ZG dd� de�ZG dd� de�ZG dd� d�Z G dd� de�Z G dd � d �Z dS ) zZookeeper functions
� N)�Enum)�Any� Generator)�NamedTemporaryFile)�contextmanager)� KazooClient)�ConnectionLoss)�KazooTimeoutError)�
retry_thisz/etc/sysconfig/zookeeper)�zk_config_file�returnc C s� t �dd�}|s�t �| t j�rzt| ddd��>}|�� D ]$}|�� �d�r6t|� d�d �}q6W d � n1 sp0 Y |s�t
d��|S ) z�
Lookup the zookeeper nodes and return them as a comma-separated string
:returns: The zookeeper nodes as a comma-separated string
ZZK_HOSTSN�rzUTF-8)�encoding�=� z"Could not retrieve Zookeeper Hosts) �os�getenv�access�R_OK�open� readlines�strip�
startswith�eval� partition�ZookeeperException)r �nodesZzkcfg�line� r �E/opt/nydus/tmp/pip-target-wkfpz8uv/lib/python/primordial/zookeeper.py� lookup_hosts s 2r c @ s� e Zd ZdZefed�dd�Zeee ddf d�dd��Z
ee d �d
d �Z ee
d �d d
�Zd ee
e
d�dd�Zeedd�dd�Zd ee dd�dd�Zdd�dd�Zed�dd�ZdS ) � Zookeeperz$Represents a connection to Zookeeper�r c C s" || _ | �� | _t| jd�| _dS )z�
Initialise a Zookeeper connection
:param zk_config_file: The path to the zookeeper config file (if not /etc/sysconfig/zookeeper)
��hostsN)r r �zk_hostsr �client��selfr r r r �__init__, s
zZookeeper.__init__N�r c c s. | j �� z| j V W | �� n
| �� 0 dS )zz
Yield a started zookeeper client in a context manager
:yields: A started instance of KazooClient
N)r& �start� stop_session�r( r r r �_start_session_cm5 s
zZookeeper._start_session_cm)�noder c C s: | � � � }|�|�duW d � S 1 s,0 Y dS )z�
Check if node exists
:param node: Name of zookeeper node
:returns: (bool) Whether the node exists
N)r. �exists�r( r/ �zkr r r r0 A s
zZookeeper.existsc C s: | � � � }|�|�d W d � S 1 s,0 Y dS )zq
Get the node value
:param node: Name of zookeeper node
:returns: The node value
r N)r. �getr1 r r r r3 J s
z
Zookeeper.get)r/ �defaultr c C sV | � � �:}|�|�dur4|�|�d W d � S W d � n1 sH0 Y |S )a5
Get a node value if it exists. If it does not exist, return the default value specified
:param node: Name of zookeeper node
:param default: The default value to return if the node does not exist
:returns: The node value or the default value if the node does not exist
Nr )r. r0 r3 )r( r/ r4 r2 r r r �get_or_defaultS s
:zZookeeper.get_or_default)r/ �valuer c C sB | � � �&}|�|� |�||�W d � S 1 s40 Y dS )z~
Set the node value
:param node: Name of zookeeper node
:param value: Value of zookeeper node
N)r. Z ensure_path�set)r( r/ r6 r2 r r r r7 _ s
z
Zookeeper.setF)r/ � recursiver c C sH | � � �,}|�|�dur&|j||d� W d � n1 s:0 Y dS )z�
Delete the node, if it exists
:param node: Name of zookeeper node
:param recursive: Whether to delete the node and all child nodes
N)r8 )r. r0 �delete)r( r/ r8 r2 r r r r9 i s
zZookeeper.deletec C s | j �� | j �� dS )z+End and close the current zookeeper sessionN)r& �stop�closer- r r r r, s s
zZookeeper.stop_sessionc C s
t | j�S )z�
Lookup the zookeeper nodes and return them as a comma-separated string
:returns: The zookeeper nodes as a comma-separated string
)r r r- r r r r x s zZookeeper.lookup_hosts)N)F)�__name__�
__module__� __qualname__�__doc__�ZK_CONFIG_FILE�strr) r r r r. �boolr0 r r3 r5 �bytesr7 r9 r, r r r r r r! ) s
r! c s@ e Zd ZdZed�eed�� fdd�Zeed�dd��Z� Z S ) �ZKFilea�
Creates a named temporary file with the contents of one or more znodes. Useful for APIs that
only accept file paths rather than file-like objects.
Warning: Because the file is a temp file there is a possibility of it being deleted by some
tempfile cleanup mechanisms (tmpwatch, etc.). In this case it may be a better idea to read
the znode into memory and create the temp file from that each time you use it.
r" )�znodesr c sD t � j|d� t� | _|D ]}|r| j�| �|�� q| j�� dS )z�
Load the znode contents into a temporary file
:param znodes: An expanded list of zookeeper node names
:param zk_config_file: The zookeeper config file (if not the default of /etc/sysconfig/zookeeper)
r" N)�superr) r �file�writer3 �flush)r( r rE Zznode�� __class__r r r) � s zZKFile.__init__r* c C s | j jS )zNGet the filename for the temporary file storing the contents of the zk node(s))rG �namer- r r r rL � s z ZKFile.name)
r< r= r> r? r@ rA r) �propertyrL �
__classcell__r r rJ r rD � s
rD c @ s e Zd ZdS )r N�r< r= r> r r r r r � s r c @ s$ e Zd ZdZdZdZdZdZdZdS )�ZKModezH
Enum to represent the mode a zk node is currently operating in
� r � � � N) r< r= r> r? �LEADER�FOLLOWER�
STANDALONE�ERROR�UNKNOWNr r r r rP � s rP c @ s� e Zd ZdZed�dd�Zdd� Zdd� Zd d
� Ze d d � �Z
e d
d� �Z e e
eejfd�d eed�dd��Ze ed�dd��Ze ed�dd��Ze ed�dd��Ze ed�dd ��Zd S ) �ZkEnsembleNodez�
This class represents a single node in a zookeeper cluster and holds to the status/mode that
node is operating in. Values are leader, follower, standalone, error or unknown.
��hostc C s* t |d�| _|�d�\| _| _tj| _dS )z�
Initialize the class.
:param host: The host:port connection for the node whose mode/state this class holds.
r# �:N)r �_ZkEnsembleNode__client�split�_ZkEnsembleNode__host�_ZkEnsembleNode__portrP rY �_ZkEnsembleNode__mode)r( r\ r r r r) � s zZkEnsembleNode.__init__c C s | j �� | j S )z�
This turns this class/object into a context manager for connections to the zookeeper node.
This starts up the connection and returns the client as the resource being managed.
)r^ r+ r- r r r � __enter__� s
zZkEnsembleNode.__enter__c C s0 z| j �� | j �� W n ty* Y n0 dS )zb
This method takes care of releasing the client connection to the zookeeper node.
N)r^ r: r; � Exception)r( Z _exc_typeZ_exc_valZ_exc_tbr r r �__exit__� s
zZkEnsembleNode.__exit__c C s d� | j| j�S )�<
Python repr implementation for this class.
zHost: {}, Mode: {})�formatr\ �moder- r r r �__repr__� s zZkEnsembleNode.__repr__c C s | j S �N)r` r- r r r r\ � s zZkEnsembleNode.hostc C s | j S rj )ra r- r r r �port� s zZkEnsembleNode.port)Z
on_ex_classesF)�forcer c C s� |s| j tjur| j S | �p}|jdd�}|dkrt|jdd�}ttdd� |�d���d }|d d
� }t|�� | _ ntj| _ W d
� n1 s�0 Y | j S ) aB
This method returns the mode the zk node is currently operating in.
If a nodes mode has already been fetched, then this method returns the cached mode/status.
To initiate a re-fetch of the status, use the force parameter.
:param force: Force re-fetch of the zk node's status/mode
s ruok)�cmdZimoks srvrc S s
| � d�S )NzMode: )r )�lr r r �<lambda>� � z+ZkEnsembleNode.fetch_mode.<locals>.<lambda>�
r � N) rb rP rY �command�list�filterr_ �upperrX )r( rl Z zk_clientZruokZsrvrZ mode_line�mr r r �
fetch_mode� s &zZkEnsembleNode.fetch_moder* c C s | j S )z?
Property to return the internally cached mode
)rb r- r r r rh � s zZkEnsembleNode.modec C s | j tjkS )z\
Python property to check if the node is currently operating as a follower.
)rh rP rV r- r r r � is_follower� s zZkEnsembleNode.is_followerc C s | j tjkS )zZ
Python property to check if the node is currently operating as a leader.
)rh rP rU r- r r r � is_leader s zZkEnsembleNode.is_leaderc C s | j tjkS )za
Python property to check if the node is currently operating in standalone mode.
)rh rP rW r- r r r �
is_standalone s z ZkEnsembleNode.is_standaloneN)F)r< r= r> r? rA r) rc re ri rM r\ rk r
r r �socket�errorrB rP rx rh ry rz r{ r r r r rZ � s&
rZ c @ s e Zd ZdS )�ZkEnsembleStatusNotGatheredNrO r r r r r~ s r~ c @ s� e Zd ZdZefed�dd�Zedd� �Zedd� �Z de
d
�d d �Z ee
d
�dd��Z ee
d
�dd��Z
ee
d
�dd��Zdd� ZdS )�ZookeeperEnsemblez�
This class is used to represent a zookeeper ensemble/cluster and test if there is currently
a quorum in the cluster.
r" c C sf || _ t|�| _| j�d�| _dd� | jD �| _tt| j�d �d | _g | _ g | _
g | _ | � � dS )z�
Initialise a Zookeeper connection
:param zk_config_file: Path to the zookeeper config file (default /etc/sysconfig/zookeeper)
�,c S s g | ]}t |d ��qS )r[ )rZ )�.0�hr r r �
<listcomp>) rp z.ZookeeperEnsemble.__init__.<locals>.<listcomp>r rQ N)
r r Zzk_hosts_conn_strr_ r% �ensemble_nodes�int�len�SIZE_FOR_QUORUM�_leaders�
_followers� _standalone�
gather_statusr' r r r r) s
zZookeeperEnsemble.__init__c C s
t | j�S )zS
Python property that returns the number of nodes in this cluster.
)r� r� r- r r r �
ensemble_size1 s z ZookeeperEnsemble.ensemble_sizec C s
t | j�S )zU
Python property that returns the number of followers in the quorum.
)r� r� r- r r r �followers_size8 s z ZookeeperEnsemble.followers_sizeF)rl c C st | j D ]&}z|�|� W q ty* Y q0 qttdd� | j ��| _ttdd� | j ��| _ttdd� | j ��| _dS )a
Method to gather the status of the nodes in the ensemble.
Note, currently if the node has a cached status, then that is what's used. We dont force
a re-fetch.
:param force: Force re-fetch of the zk node's status/mode
c S s | j S rj )rz �r/ r r r ro N rp z1ZookeeperEnsemble.gather_status.<locals>.<lambda>c S s | j S rj )ry r� r r r ro O rp c S s | j S rj )r{ r� r r r ro P rp N)r� rx rd rt ru r� r� r� )r( rl r/ r r r r� ? s
z ZookeeperEnsemble.gather_statusr* c C s t | j�dkS )zZ
Python property to check if the cluster is operating in standalone mode.
r )r� r� r- r r r �is_in_standalone_modeR s z'ZookeeperEnsemble.is_in_standalone_modec C s t | j�dkS )zx
Python property to check if the cluster has a split brain, perhaps as a result of a network partition.
rQ )r� r� r- r r r �has_split_brainY s z!ZookeeperEnsemble.has_split_brainc C s* | j o(| j o(t| j�t| j� | jkS )z�
Python property to check if the cluster currently has quorum.
Make sure gather_status has been called before we call this method.
)r� r� r� r� r� r� r- r r r �
has_quorum` s
��z ZookeeperEnsemble.has_quorumc C s� d� dd� | jD ��}| jr&d}d}n8| jrVd�| jd j�}d� dd� | jD ��}nd}d}d � d
d� | jD ��}d �|| j | j|||�S ) rf z, c S s g | ]
}|j �qS r r[ )r� �nr r r r� r rp z.ZookeeperEnsemble.__repr__.<locals>.<listcomp>rW �{}r c S s g | ]
}|j �qS r r[ )r� �fr r r r� y rp z SPLIT BRAINz
c S s g | ]}d � |��qS )r� )rg )r� r/ r r r r� ~ rp zPNodes: {}
Ensemble mode? {}
Has Quorum? {}
Leader: {}
Followers: {}
Details:
{})�joinr� r� r� rg r� r\ r� )r( Zzk_nodesZleaderZ followers�detailsr r r ri n s �zZookeeperEnsemble.__repr__N)F)r< r= r> r? r@ rA r) rM r� r� rB r� r� r� r� ri r r r r r s
r ) r? r r| �enumr �typingr r �tempfiler �
contextlibr Z kazoo.clientr Zkazoo.exceptionsr Zkazoo.handlers.threadingr Zprimordial.utilsr
r@ rA r r! rD rd r rP rZ r~ r r r r r �<module> s& W i