U Jh @s<ddlZddlZddlZddlZddlZddlZddlZddlZddlZddl m Z m Z ddl m Z mZmZmZmZmZmZddlZddlmZddlmZmZmZmZmZmZmZddlm Z ddl!m"Z"dZ#d Z$d Z%d Z&d Z'd Z(dZ)dZ*dZ+dZ,dZ-dZ.dZ/dZ0dZ1dZ2dZ3dZ4dZ5ej67e dej67e dgej67e dej67e dej67e dej67e d gd!Z8d"d#d$gZ9e:Z;eZ?ej@Gd%d&d&ejAZBed'd(eCfd)eCfd*eCfgZDd+d,ZEeEeCeCd-d.d/ZFd0d1ZGeCeeCd2d3d4ZHdeeCeeCee eCeCfeCd5d6d7ZIe dd8deeCee eCeCfeCd9d:d;ZJGdd?ZLd@dAZMeCeeCdBdCdDZNdeCeOeeCdFdGdHZPdee eCeCfeCdIdJdKZQeRejSejTfe9eCdLdMdNZUdeeCeeeCee eCeCfeCdOdPdQZVeCeejWdRdSdTZXeeCeejWdRdUdVZYdejWeeCeejZdWdXdYZ[eeCeCeOeCeCdZd[d\Z\deeCeCeOeCeCeOeCd]d^d_Z]deCeCeCeeCeCeeCeeOdd`dadbZ^dcddZ_dedfZ`deCeCeeCeeCddgdhdiZadjdkZbdldmZcdndoZddpdqZeeCeOdrdsdtZfeeDdudvdwZgeeCdudxdyZhddeBjifeeCeeCeeBddzd{d|Zjeekdud}d~ZleekduddZmeejduddZnddZodduddZpeeCeCdddZqeeCeCdddZreeCdddZsddZtddZueeCe eCeeCeeCffdddZveCduddZwdS)N) lru_cachewraps)DictIterableList NamedTupleOptionalSetUnion)AcquireProgress) event_logger exceptionsgpgmessagessecret_managersystemutil)ESM_APT_ROOTDIR)status_cache_filegN@z # ubuntu-pro-clientzDir::Etc::netrc/zDir::Etc::netrcparts/zDir::State::lists/a/* * Autogenerated by ubuntu-pro-client * Do not edit this file directly * * To change what ubuntu-pro-client sets, use the `pro config set` * or the `pro config unset` commands to set/unset either: * global_apt_http_proxy and global_apt_https_proxy * for a global apt proxy * or * ua_apt_http_proxy and ua_apt_https_proxy * for an apt proxy that only applies to Ubuntu Pro related repos. */ z$Acquire::http::Proxy "{proxy_url}"; z%Acquire::https::Proxy "{proxy_url}"; z4Acquire::http::Proxy::esm.ubuntu.com "{proxy_url}"; z5Acquire::https::Proxy::esm.ubuntu.com "{proxy_url}"; z/etc/apt/trusted.gpg.d/z/usr/share/keyringsz/usr/lib/apt/methods/httpsz /usr/sbin/update-ca-certificatesz//etc/apt/apt.conf.d/90ubuntu-advantage-aptproxyz*/var/lib/apt/periodic/update-success-stampz/var/lib/dpkg/status)ZxenialZbionicZfocalZjammyz# Written by ubuntu-pro-client Types: deb{deb_src} URIs: {url} Suites: {suites} Components: main Signed-By: {keyrings_dir}/{keyring_file} zetc/apt/sources.listzvar/lib/dpkg/statuszetc/apt/apt.conf.dzetc/apt/preferences.dzvar/cache/apt/archives/partialzvar/lib/apt/lists/partial)filesfoldersg?g@g$@c@seZdZeZeZdS) AptProxyScopeN)__name__ __module__ __qualname__objectGLOBALUACLIENTrr./usr/lib/python3/dist-packages/uaclient/apt.pyrcsrInstalledAptPackagenameversionarchcstfdd}|S)z*Decorator ensuring apt_pkg is initialized.cs"tjddkrt||S)NDir)apt_pkgconfiggetinit)argskwargsfrrnew_fqsz"ensure_apt_pkg_init..new_f)r)r-r.rr,rensure_apt_pkg_initnsr/abcCs t||SN)r&version_comparer0rrrr4|sr4c Cs|d\}}tjdsdSzFt4}tjddd||||tj |dgt t dW5QRXWnt j k r}zntdt||jd krt|j}td |rt j|d ntd |rt j|d t jt|d W5d}~XYn&tjk rt jt |dYnXdS)aValidate apt credentials for a PPA. @param repo_url: private-ppa url path @param username: PPA login username. @param password: PPA login password or resource token. @raises: UbuntuProError for invalid credentials, timeout or unexpected errors. ://z/usr/lib/apt/apt-helperNz download-filez{}://{}:{}@{}/pool/zapt-helper-output)Ztimeout retry_sleepszError running apt-helper: %sdz401\s+unauthorized|httperror401)repozconnection timed outZdetail)Zsecondsr8)splitospathexiststempfileZTemporaryDirectoryrsubpformatjoinAPT_HELPER_TIMEOUT APT_RETRIESr ProcessExecutionErrorLOGerrorstrZ exit_codestderrlowerresearchZAPTInvalidCredentialsZ APTTimeoutAPTUnexpectedError subprocessZTimeoutExpiredZAPTCommandTimeout)repo_urlusernamepasswordZprotocol repo_pathZtmpderHrrrassert_valid_apt_credentialssB          rS) apt_errorreturncCsVt}|dD]<}|rtd|}|rd|ddd}||q|S)aAParse apt update errors for invalid apt config in user machine. This functions parses apt update errors regarding the presence of invalid apt config in the system, for example, a ppa that cannot be reached, for example. In that scenario, apt will output a message in the following formats: The repository 'ppa 404 Release' ... Failed to fetch ppa 404 ... On some releases, both of these errors will be present in the apt error message. :param apt_error: The apt error string :return: a NamedMessage containing the error message  z2(Failed to fetch |The repository .)(?P[^\s]+)z- urlz/distsr)setstripr:rJrK groupdictadd)rT failed_reposlineZ pattern_matchZrepo_url_matchrrr(_parse_apt_update_for_invalid_apt_configs r^)cmd error_msgoverride_env_varsrUc Csztj|dt|d\}}Wntjk r}zrtdt|t|dt|jkr\t n$t |j}|rtj d t |d|r|nt|}tj|dW5d}~XYnX|S) aRun an apt command, retrying upon failure APT_RETRIES times. :param cmd: List containing the apt command to run, passed to subp. :param error_msg: The string to raise as UbuntuProError when all retries are exhausted in failure. :param override_env_vars: Passed directly as subp's override_env_vars arg :return: stdout from successful run of the apt command. :raise UbuntuProError: on issues running apt-cache policy. T)Zcapturer6raz Error running apt command %s: %sz%Could not get lock /var/lib/dpkg/lockrV)r\r9N)rr?rCr rDrErFrGrHAPTProcessConflictErrorr^APTInvalidRepoErrorrAsortedrL)r_r`raout_errrRr\msgrrrrun_apt_commands&   rh)maxsize)r`rarUcCstddg||dS)N apt-cachepolicy)r_r`ra)rh)r`rarrrget_apt_cache_policys rlc@s$eZdZddZddZddZdS)PreserveAptCfgcCs||_i|_dSr3)apt_funccurrent_apt_cfg)selfrnrrr__init__ szPreserveAptCfg.__init__cs&tjfddD|_|S)Ncsi|]}|t|qSr)copydeepcopyr().0keycfgrr sz,PreserveAptCfg.__enter__..)r&r'keysrorn)rprrvr __enter__ s  zPreserveAptCfg.__enter__cCs4tj}|jD]}|||j|qtdSr3)r&r'roryrXZ init_system)rptypevalue tracebackrwrurrr__exit__szPreserveAptCfg.__exit__N)rrrrqrzr~rrrrrmsrmcCs.tjD]}tj|q ttdSr3)r&r'ryclearr)Cacherurrrget_apt_pkg_cachesrcCsnzPttjD]}td|stj|qtjdtt t dWSt k rhiYSXdS)Nz^Acquirer$) _ensure_esm_cache_structurer&r'ryrJrKrrXrr)r Exceptionrrrrget_esm_apt_pkg_cache&s  r)pkg_namerUc CsTtt4}z ||}Wn tk r6YW5QRdSXW5QRX|jrP|jjSdSr3)rmrKeyError current_verver_str)rcachepackagerrrget_pkg_version>s  rF)rcheck_esm_cacherUc Cstt`}z ||}Wn tk r6YW5QRdSXt|}||}|s^W5QRdS|j}W5QRX|sv|Stt}|rz ||}Wn$tk r|YW5QRSXt|} | |} | s|W5QRS| j} t| |dkr| W5QRSW5QRX|S)Nr) rmrrr&DepCacheget_candidate_verrrr4) rrrr dep_cache candidateZcandidate_versionZ esm_cacheZ esm_packageZ esm_dep_cacheZ esm_candidateZesm_candidate_versionrrrget_pkg_candidate_versionKs@        r)rarUc Cszztddg|d}Wntjk rR}ztdt|tW5d}~XYnbtj k r}ztj |j dW5d}~XYn2tj k r}ztj |j dW5d}~XYnXW5tX|S)Napt-getupdater_raz Error running apt-get update: %sZrepo_msgr9)rl cache_clearrhr rbrErFrGZAPTUpdateProcessConflictErrorrcZAPTUpdateInvalidRepoErrorrgZUbuntuProErrorAPTUpdateFailed)rarerRrrrrun_apt_update_commandws $ r)sources_list_pathc Cs*tt}tjdtj|tjddtjddt}| t }tj tj dd}t |}zz"||||dW5QRXWntttd d k r}ztd t|tW5d}~XYn4tk r }ztjt|d W5d}~XYnXW5tXW5QRXdS) NzDir::Etc::sourcelistzDir::Etc::sourcepartszN.O.F.O.L.D.E.RzAPT::List-Cleanup0zDir::State::ListslockrErrorrzError updating apt cache: %sr9)rmrr&r'rXr;r<abspath SourceListread_main_listr rAZfind_dirZFileLockrlrrgetattrrErFrGr rb SystemErrorr)rr sources_listfetch_progressZ lock_filerrRrrrupdate_sources_lists0    &r)packages apt_optionsrarUc Cs|dkr g}ztdddg|||d}WnZtjk rTtd|tYn2tjk r}ztj|jdW5d}~XYnX|S)Nrinstall --assume-yesrz)Error running apt install for packages %sr) rhr rbrErFZAPTInstallProcessConflictErrorrcZAPTInstallInvalidRepoErrorrg)rrrarerRrrrrun_apt_install_commands"    r)originrUc Cs\t}tt@}|jD]2}|j}|r|jD]\}}|j|kr*||q*qW5QRXt|Sr3) rXrmrrr file_listrr[list)rresultrrinstalled_versionfile_rrr get_installed_packages_by_origins   rc Cs|dkr gSt}tt`}t|}|jD]H}|j}|r,||}|r,||kr,|jD]\}}|j |krV| |qVq,W5QRXt |Sr3) rXrmrr&rrrrrrr[r) rrrrrrrrrrrr;get_installed_packages_with_uninstalled_candidate_in_origins      r)rexclude_originrUcs6g}|jD]&}fdd|jD}|r ||q |S)Ncs(g|] \}}|jdkr|jkr|qS)Znow)Z componentr)rtrrrrr s z3get_remote_versions_for_package..)Z version_listrappend)rrZvalid_versionsr"Z valid_originsrrrget_remote_versions_for_packages   r)suitesseriesupdates_enabledrNrUcCsRd}|D]D}||krqd}d|kr8|s8td||d}|dj|||d7}q|S)Nr%-updatesz?Not enabling apt suite "%s" because "%s-updates" is not enabledz# zC{maybe_comment}deb {url} {suite} main # deb-src {url} {suite} main ) maybe_commentrWsuite)rEwarningr@)rrrrNcontentrrrrr_get_list_file_content s( r)rrrrN keyring_fileinclude_deb_srcrUc sZfdd|D}|s0tddd|D}|r8dnd}tj|d|t||d}|S) Ncsg|]}|kr|qSrrrtrrrrr+sz-_get_sources_file_content..zPNot enabling service-related -updates suites because "%s-updates" is not enabledcSsg|]}d|kr|qS)rrrrrrr2sz deb-srcr% )rWrZ keyrings_dirrdeb_src)rErDEB822_REPO_FILE_CONTENTr@rA KEYRINGS_DIR) rrrrNrrZappliable_suitesrrrrr_get_sources_file_content#s$ r) repo_filenamerN credentialsrr snapshot_urlscheck_updates_pocketrUcCs2z|d\}}Wntk r.d}|}YnXtj|tj} |dr\|dd}t |||d} |rd} t dd gt j } | D]&} d | | krqd | krqd} qq|g|D]} t| ||q| tkrtjt|}tjt|}t||t|| | |}nt|| | ||}t||dS) zAdd an authenticated apt repo and credentials to the system. @raises: InvalidAPTCredentialsError when the token provided can't access the repo PPA. :Zbearer/NTFrjrkz a={}-updatesz o=Ubuntu,)r: ValueErrorrZsecretsZ add_secretrZget_release_inforendswithrSrhrZAPT_POLICY_FAILED splitlinesr@add_apt_auth_conf_entrySERIES_NOT_USING_DEB822r;r<rAr APT_KEYS_DIRrZexport_gpg_keyrr write_file)rrNrrrrrrOrPrrrkr]rWZsource_keyring_fileZdestination_keyring_filerrrradd_auth_apt_repoCsX         rc Cst}d|kr|d\}}n|}|ds4|d7}tj|rLt|}nd}dj|||t d}d}g} | D]\} |s| } t | dkr| d} | |kr| |d }qr| |kr| |d }| | qr|s| || dtj |d | d d d S)zBAdd or replace an apt auth line in apt's auth.conf file or conf.d.r5rr%z:machine {repo_path} login {login} password {password}{cmt})rQloginrPZcmtFTrVmodeN)!get_apt_auth_file_from_apt_configr:rr;r<r=r load_filer@APT_AUTH_COMMENTrlenrrrA) rNrrP apt_auth_file _protocolrQZ orig_contentZrepo_auth_lineZadded_new_authZ new_linesr]Z split_lineZcurr_line_reporrrrsF           rcsd|kr|d\}}n|}|dr2|dd}t}tj|rt|}dj|dd fdd | D}|st |ntj ||d d dS) z+Remove a repo from the shared apt auth filer5rNrzmachine {repo_path}/ login)rQrVcsg|]}|kr|qSrr)rtr]Z auth_prefixrrrsz2remove_repo_from_apt_auth_file..rr) r:rrr;r<r=rrr@rArensure_file_absentr)rNrrQrZapt_authrrrrremove_repo_from_apt_auth_files      r)rrNrrrUcCs^t||dr&tt|d|rBtjt|}t||g|D] }t |qLdS)z>Remove an authenticated apt repo and credentials to the systemz.sourcesrN) rrrrZset_filename_extensionr;r<rArr)rrNrrrWrrrremove_auth_apt_repos    rcCsB|d\}}|dr$|dd}dj||d}t||dS)z.Add an apt preferences file and pin for a PPA.r5rNrz.)r)Z package_listZ pkg_namesrrrr(sr) http_proxy https_proxy proxy_scoperUcCs|s|rB|rBd}|tjkr d}n|tjkr.d}ttjj|dd}|r|tjkrf|tj|d7}n|tjkr|t j|d7}|r|tjkr|t j|d7}n|tjkr|t j|d7}|dkrt |}|dkrt tn t t|dS)a Writes an apt conf file that configures apt to use the proxies provided as args. If both args are None, then no apt conf file is written. If this function previously wrote a conf file, and was run again with both args as None, the existing file is removed. :param http_proxy: the url of the http proxy apt should use, or None :param https_proxy: the url of the https proxy apt should use, or None :return: None r%z UA-scopedglobal)Zscope)Z proxy_urlN)rrreventinforZSETTING_SERVICE_PROXY_SCOPEr@APT_CONFIG_UA_PROXY_HTTPAPT_CONFIG_GLOBAL_PROXY_HTTPAPT_CONFIG_UA_PROXY_HTTPSAPT_CONFIG_GLOBAL_PROXY_HTTPSAPT_PROXY_CONFIG_HEADERrrAPT_PROXY_CONF_FILEr)rrrmessageZapt_proxy_configrrrsetup_apt_proxy.sD          rcCs d}tjtrttj}|Sr3)r;r<r=APT_UPDATE_SUCCESS_STAMP_PATHstatst_mtimeZ cache_timerrrget_apt_cache_timefs  r cCs d}tjtrttj}|Sr3)r;r<r=DPKG_STATUS_PATHr r )Z status_timerrrget_dpkg_status_timems  rcCs$t}|dkrdStj|tjjSr3)r datetimeZ fromtimestamptimezoneZutcr rrrget_apt_cache_datetimetsrcstjtjtdddtdtd}tfdd|DrBdStttdD]}t |qTtdD]}tj |ddd qldS) Nz**/*T) recursiverrc3s|]}|kVqdSr3r)rtrZexisting_filesrr sz._ensure_esm_cache_structure..i)exist_okr) rr;r<rArESM_BASIC_FILE_STRUCTUREallrZensure_folder_absentZ create_filemakedirs)Z desired_filesrZfolderrrrr{s     rc Csts dStddlm}ddlm}ddlm}m }d}d}t }|dkr^||d}| dgD]D}| ddd kr| d d d k}| ddd krj| d d d k}qj||} |r| d|jkr| n| tr||} |r| d|jkr| n| ttx} t} | Gdddt} | }z| || dWn8tk r}ztdt|W5d}~XYnXW5QRXdS)Nr)status)ApplicationStatus)ESMAppsEntitlementESMInfraEntitlementFservicesr!r%zesm-appsZ availableZnoZyesz esm-infrac@s,eZdZejdddZejdddZdS)z-update_esm_caches..EsmAcquireProgress)itemcSstd|jdS)NzFetched ESM Apt Cache item: {})rEdebugr@urirprrrrdonesz2update_esm_caches..EsmAcquireProgress.donecSstd|jdS)Nz&Failed to fetch ESM Apt Cache item: {})rErr@r!r"rrrfails z2update_esm_caches..EsmAcquireProgress.failN)rrrr&ZAcquireItemDescr#r$rrrrEsmAcquireProgresssr%z%Failed to fetch the ESM Apt Cache: {})rZis_current_series_ltsrZuaclient.actionsrZ(uaclient.entitlements.entitlement_statusrZuaclient.entitlements.esmrrrreadr(Zapplication_statusZDISABLEDZsetup_local_esm_repoZdisable_local_esm_repoZis_current_series_active_esmrmrr&rrr rrrErr@rG)rwrrrrZapps_availableZinfra_availableZcurrent_statusserviceZappsZinfrarrr%rrRrrrupdate_esm_cachessP        r( package_namesZ error_messagecCs(tdddddgt||ddidd S) a Remove APT packages from the system. Setting DEBIAN_FRONTEND to noninteractive makes sure no prompts will appear during the operation. In this case, --force-confdef will automatically pick the default option when some debconf should appear. In the absence of a default option, --force-confold will automatically choose to keep the old configuration file. rremover$-o Dpkg::Options::="--force-confdef"$-o Dpkg::Options::="--force-confold"DEBIAN_FRONTENDnoninteractiveraNrhrr)rrrremove_packagess r2cCs(tdddddgt||ddidd S) a Purge APT packages from the system - remove everything. Setting DEBIAN_FRONTEND to noninteractive makes sure no prompts will appear during the operation. In this case, --force-confdef will automatically pick the default option when some debconf should appear. In the absence of a default option, --force-confold will automatically choose to keep the old configuration file. rpurgerr,r-r.r/r0Nr1r)rrrpurge_packagess r4r*cCst|dddgddiddS)a6 Install packages, allowing downgrades. The --allow downgrades flag is needed because sometimes we need to reinstall the packages to a lower version (passed in the package_name string, as package=version). Setting DEBIAN_FRONTEND to noninteractive makes sure no prompts will appear during the operation. In this case, --force-confdef will automatically pick the default option when some debconf should appear. In the absence of a default option, --force-confold will automatically choose to keep the old configuration file. z--allow-downgradesr,r-r.r/)rraN)rr5rrrreinstall_packagessr6cCs*tjD]}tj|q ttjSr3)r&r'ryrZ init_configrrrr_get_apt_configsr7c Cs"tt}||}W5QRX|Sr3)rmr7r)Zbase_keyapt_cfgZ apt_cfg_keysrrrget_apt_config_keys(s r9) cfg_namesrUc CsNi}tt8}|D],}||}t|s6||p4d}|||<qW5QRX|S)z Get all APT configuration values for the given config names. If one of the config names is not present on the APT config, that config name will have a value of None N)rmr7r(rGZ value_list)r:Z apt_cfg_dictr8Zcfg_nameZ cfg_valuerrrget_apt_config_values/s  r;cCsd}d}tj|r|S|S)Nz/etc/apt/sources.listz&/etc/apt/sources.list.d/ubuntu.sources)r;r<r=)Zold_sources_pathZnew_sources_pathrrrget_system_sources_fileEs  r<)NN)NN)F)N)NN)N)F)F)N)xrrrenumrZloggingr;rJrMr> functoolsrrtypingrrrrrr r r&Zapt.progress.baser Zuaclientr r rrrrrZuaclient.defaultsrZuaclient.files.state_filesrrBrrrrrrrrrrrZAPT_METHOD_HTTPS_FILEZCA_CERTIFICATES_FILErr rrrr<rArrCZget_event_loggerrZ getLoggerZreplace_top_level_logger_namerrEuniqueEnumrrGr r/r4rSr^rhrlrmrrrboolrrZretryrbrrrZPackagerrZVersionrrrrrrrrrrrrrrrrfloatr rrrr(r2r4r6r7r9r;r<rrrrsl$ $         + ( +  -  (      ' A/   8E