U (f=@s`ddlZddlZddlZddlZddlZddlZddlZddlZddlm Z ddl m Z m Z m Z mZmZddlmZmZddlmZddlmZeZeeddd ZeeeZGd d d ejZGd d d ej Z!ddZ"d\e ee fe ee fee ee fdddZ#dgfee eedddZ$d]ee%e%e%dddZ&e ee fee%dddZ'ddd d!d"d#d$d%d&d'd(d)d*d+d!d,d-d.d/d0d1d2d3d4d5d6gZ(e(fe eed7d8d9Z)eee%e%d:d;d<Z*eejd=d>d?Z+eed@dAdBZ,dCdDZ-dEdFZ.dGdHdIdJdKdLZ/eedMdNdOZ0e ee edPdQdRZ1e%dSdTdUZ2eeedVdWdXZ3e edYdZd[Z4dS)^Nwraps)AnyDictListOptionalUnion) exceptionsmessages)CONFIG_FIELD_ENVVAR_ALLOWLIST)MessagingOperations)namereturncCs(|dkr dS|d}d|d<d|S)z1Replace the name of the root logger from __name__.Z ubuntupror)splitjoin)r namesr//usr/lib/python3/dist-packages/uaclient/util.pyreplace_top_level_logger_names  rcs eZdZdZfddZZS)DatetimeAwareJSONEncoderzBA json.JSONEncoder subclass that writes out isoformat'd datetimes.cs t|tjr|St|SN) isinstancedatetimeZ isoformatsuperdefault)selfo __class__rrr"s z DatetimeAwareJSONEncoder.default)__name__ __module__ __qualname____doc__r __classcell__rrrrrsrcs,eZdZdZfddZeddZZS)DatetimeAwareJSONDecodera, A JSONDecoder that parses some ISO datetime strings to datetime objects. Important note: the "some" is because we seem to only be able extend Python's json library in a way that lets us convert string values within JSON objects (e.g. '{"lastModified": "2019-07-25T14:35:51"}'). Strings outside of JSON objects (e.g. '"2019-07-25T14:35:51"') will not be passed through our decoder. (N.B. This will override any object_hook specified using arguments to it, or used in load or loads calls that specify this as the cls.) cs.d|kr|dtj|d|ji|dS)N object_hook)popr__init__r')rargskwargsrrrr)6s z!DatetimeAwareJSONDecoder.__init__c CsN|D]@\}}t|trz t|}Wntk r>|}YnX|||<q|Sr)itemsrstrparse_rfc3339_date ValueError)rkeyvalue new_valuerrrr';s   z$DatetimeAwareJSONDecoder.object_hook)r!r"r#r$r) staticmethodr'r%rrrrr&(s r&csfdd}|S)aDecorator to retry on exception for retry_sleeps. @param retry_sleeps: List of sleep lengths to apply between retries. Specifying a list of [0.5, 1] tells subp to retry twice on failure; sleeping half a second before the first retry and 1 second before the second retry. @param exception: The exception class to catch and retry for the provided retry_sleeps. Any other exception types will not be caught by the decorator. cstfdd}|S)Nc sl}z ||WSk rd}z2|s.|tdt|t|t|dW5d}~XYqXqdS)Nz%s: Retrying %d more times.r)copyLOGdebugr-lentimesleepr()r*r+Zsleepse) exceptionf retry_sleepsrr decoratorWs z)retry..wrapper..decoratorr)r<r>r;r=)r<rwrapperVs zretry..wrapperr)r;r=r@rr?rretryJs rAr) orig_dictnew_dictpathrc Csi}|D]\}}||t}|s(|n |d|}t|trp||krft||||d}|rn|||<qt||<q ||kr td|t||||<q |D]\}}||kr|||<q|S)zsz"prompt_choices..z> )uaclientrKZget_event_loggerformatrinfoinputlower)rIrJrKZeventr1Z error_msgrrrprompt_choicess    rTF)rI assume_yesrrcCs>|rdS|stj}t|}|dkr.|S|dkr:dSdS)a Display a confirmation prompt, returning a bool indicating the response :param msg: String custom prompt text to emit from input call. :param assume_yes: Boolean set True to skip confirmation input and return True. :param default: Boolean to return when user doesn't enter any text This function will only prompt a single time, and defaults to "no" (i.e. it returns False). Tr)yZyesF)r Z PROMPT_YES_NOrRrSstrip)rIrUrr1rrrprompt_for_confirmationsrX)config path_to_valuercCs|}i}|d}|d}|D].}||kr.d}t|trF|||}qdSqt|}|dkrfdS|dkrvdStj|d|dd S) aJCheck if value parameter can be translated into a boolean 'True' value. @param config: A config dict representing /etc/ubuntu-advantange/uaclient.conf @param path_to_value: The path from where the value parameter was extracted. @return: A boolean value indicating if the value paramater corresponds to a 'True' boolean value. @raises exceptions.UbuntuProError when the value provide by the path_to_value parameter can not be translated into either a 'False' or 'True' boolean value. rZfalseFtrueTzboolean string: true or false)rZZexpected_valuer1N)rrrGrEr-rSr ZInvalidBooleanConfigValue)rYrZr1Z default_valuepathsZ leaf_valuer0Z value_strrrris_config_value_trues(     r^z(Bearer )[^\']+z(\'attach\', \')[^\']+z(\'machineToken\': \')[^\']+z(\'token\': \')[^\']+z((\'X-aws-ec2-metadata-token\': \')[^\']+z*(.*\[PUT\] response.*api/token,.*data: ).*z(https://bearer:)[^\@]+z1(/snap/bin/canonical-livepatch\s+enable\s+)[^\s]+z>(Contract\s+value\s+for\s+'resourceToken'\s+changed\s+to\s+).*z(\'resourceToken\': \')[^\']+z(\'contractToken\': \')[^\']+zF(https://contracts.canonical.com/v1/resources/livepatch\?token=)[^\s]+z(\"identityToken\": \")[^\"]+zT(response:\s+http://metadata/computeMetadata/v1/instance/service-accounts.*data: ).*z(\'userCode\': \')[^\']+z(\'magic_token=)[^\']+z(--registration-key=\")[^\"]+z(--registration-key=\')[^\']+z(--registration-key=)[^ ]+z(--registration-key \")[^\"]+z(--registration-key \')[^\']+z(--registration-key )[^\s]+z (-p \")[^\"]+z (-p \')[^\']+z (-p )[^\s]+) redact_regexsrcCs |}|D]}t|d|}q|S)z4Redact known sensitive information from log content.z\g<1>)resub)logr_Z redacted_logZ redact_regexrrrredact_sensitive_logssrc)msg_opsrUrcCsJ|sdS|D]8}t|tr$t|q |\}}||d<|f|s dSq dS)ahEmit messages to the console for user interaction :param msg_op: A list of strings or tuples. Any string items are printed. Any tuples will contain a callable and a dict of args to pass to the callable. Callables are expected to return True on success and False upon failure. :return: True upon success, False on failure. TrUF)rr-print)rdrUZmsg_opZfunctorr*rrrhandle_message_operations s    rf)dt_strrcCsDtdd|}tdd|}|dd}tdd|}tj|d S) aT Parse a datestring in rfc3339 format. Originally written for compatibility with golang's time.MarshalJSON function. Also handles output of pythons isoformat datetime method. This drops subseconds. :param dt_str: a date string in rfc3339 format :return: datetime.datetime object of time represented by dt_str z(\d{2}:\d{2}:\d{2})\.\d+z\g<1>z(\d{2}:\d{2}:\d{2})$z\g<1>ZZz+00:00z(-|\+)(\d{2}):(\d{2})$z\g<1>\g<2>\g<3>z%Y-%m-%dT%H:%M:%S%z)r`rareplacerstrptime)rgZdt_str_without_subsecondsZ dt_str_with_zZdt_str_without_zZdt_str_with_pythonish_tzrrrr.&s(  r.)messagercCs`tjjdksdtjjkr\|dd}|tjdd}|tjdd}|dd }|S) z} Verify if the system can output unicode characters and if not, remove those characters from the message string. NzUTF-8u—- rasciiignore) sysstdoutencodingrLrir Z OKGREEN_CHECKZFAIL_Xencodedecode)rkrrrhandle_unicode_characters]s  rucCsddtjDS)NcSs4i|],\}}|tks*|ds*|dkr||qS)Z UA_FEATURESZUA_CONFIG_FILE)rSr startswith)rMkvrrr xs   z'get_pro_environment..)osenvironr,rrrrget_pro_environmentwsr|cCsdd}|D]\}}||}t|trFt|trFt|||qt|trt|trt|rt|dtr|||||dq|||<q|||<qdS)aMerge the contents of overlay dict into base_dict not only on top-level keys, but on all on the depths of the overlay_dict object. For example, using these values as entries for the function: base_dict = {"a": 1, "b": {"c": 2, "d": 3}} overlay_dict = {"b": {"c": 10}} Should update base_dict into: {"a": 1, "b": {"c": 10, "d": 3}} @param base_dict: The dict to be updated @param overlay_dict: The dict with information to be added into base_dict c Ssxdddd}g}||}|D]J}d}t|D]*\}} | |||kr.t| |d}q.|s||q||dS)Nr typeZselector)ZavailableResourcesZresourceEntitlementsZ overridesFT)rE enumeratedepth_first_merge_overlay_dictappendextend) Z base_valuesZoverlay_valuesr0Zmerge_id_key_mapZvalues_to_appendZid_keyZ overlay_valueZ was_replacedZbase_value_idx base_valuerrrupdate_dict_lists   z8depth_first_merge_overlay_dict..update_dict_listr)r0N)r,rErrGrlistr7)Z base_dictZ overlay_dictrr0r1rrrrrs  rZamd64Zi386Zppc64elZarm64Zarmhf)Zx86_64Zi686Zppc64leZaarch64Zarmv7l)archrcCs|}t||Sr)rS ARCH_ALIASESrE)rZ arch_lowerrrrstandardize_arch_namesr)archesrcCs*t}|D]}|t|q tt|Sr)setaddrsortedr)rZdeduplicated_archesrrrrdeduplicate_archessr)rcCs tdkS)Nr)rzgetuidrrrrwe_are_currently_rootsr)filename new_extensionrcCstj|\}}|d|S)Nr)rzrDsplitext)rrr Z _extensionrrrset_filename_extensionsrZ package_listc Cs&dtjd|dddddddS)N rmPFz )widthZbreak_long_wordsZbreak_on_hyphensZinitial_indentZsubsequent_indent)rtextwrapZwraprrrrcreate_package_list_strs r)r)rFF)5rZjsonZloggingrzr`rprr8 functoolsrtypingrrrrrrOr r Zuaclient.defaultsr Zuaclient.typesr objectrFr-rZ getLoggerr!r5Z JSONEncoderrZ JSONDecoderr&rArHrTboolrXr^ZREDACT_SENSITIVE_LOGSrcrfr.rur|rrrrrrrrrrrs     "!   (   7 5